-- Logs begin at Fri 2022-05-13 16:23:49 UTC, end at Fri 2022-05-13 17:49:50 UTC. -- May 13 17:17:32.534637 dv-cinder-841782-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 13 17:17:32.542862 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 13 17:17:32.545913 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 13 17:17:32 2022] *** May 13 17:17:32.545913 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 13 17:17:32.545913 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 13 17:17:32.545913 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: nodename: dv-cinder-841782-1-iscsi May 13 17:17:32.545913 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: machine: x86_64 May 13 17:17:32.545913 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: clock source: unix May 13 17:17:32.545913 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: pcre jit disabled May 13 17:17:32.545913 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: detected number of CPU cores: 4 May 13 17:17:32.545913 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: current working directory: / May 13 17:17:32.545913 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: detected binary path: /usr/bin/uwsgi-core May 13 17:17:32.546473 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: your processes number limit is 47680 May 13 17:17:32.546473 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: your memory page size is 4096 bytes May 13 17:17:32.546473 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: detected max file descriptor number: 2048 May 13 17:17:32.546473 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: lock engine: pthread robust mutexes May 13 17:17:32.546473 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: thunder lock: enabled May 13 17:17:32.546473 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 13 17:17:32.546473 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 13 17:17:32.592202 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: Python main interpreter initialized at 0x557e28fc99c0 May 13 17:17:32.592202 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: python threads support enabled May 13 17:17:32.592202 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: your server socket listen backlog is limited to 100 connections May 13 17:17:32.592202 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: your mercy for graceful operations on workers is 90 seconds May 13 17:17:32.592632 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: mapped 403077 bytes (393 KB) for 2 cores May 13 17:17:32.592632 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: *** Operational MODE: preforking *** May 13 17:17:32.592908 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: *** uWSGI is running in multiple interpreter mode *** May 13 17:17:32.592908 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: spawned uWSGI master process (pid: 102948) May 13 17:17:32.593102 dv-cinder-841782-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 13 17:17:32.595215 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: spawned uWSGI worker 1 (pid: 102949, cores: 1) May 13 17:17:32.595215 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: spawned uWSGI worker 2 (pid: 102950, cores: 1) May 13 17:17:32.595215 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 13 17:17:33.793447 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 17:17:33.794061 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 17:17:34.523467 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 17:17:34.523467 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: from cryptography.utils import int_from_bytes May 13 17:17:34.523873 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 17:17:34.523873 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: from cryptography.utils import int_from_bytes May 13 17:17:34.525968 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 17:17:34.525968 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: from cryptography.utils import int_from_bytes May 13 17:17:34.526420 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 17:17:34.526420 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: from cryptography.utils import int_from_bytes May 13 17:17:37.130099 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 17:17:37.130681 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 17:17:37.130884 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 17:17:37.131272 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 17:17:37.131534 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 17:17:37.131925 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.132079 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 17:17:37.132447 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.132531 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 17:17:37.132619 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.132911 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 17:17:37.133520 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.133756 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.133849 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 17:17:37.134039 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 17:17:37.134123 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.134381 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.134549 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.134702 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.134794 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.135030 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.135148 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.135337 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.135438 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.135659 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.135751 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.135987 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841782-1-iscsi {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.136073 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.136314 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.136407 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.136626 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.136717 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.136940 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.137049 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.137206 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.137302 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.137529 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.137616 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.137860 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841782-1-iscsi {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.137954 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.138167 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.138252 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.138487 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.138664 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.138806 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.139119 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.139245 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.139455 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.139551 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.139771 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.139874 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.140081 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.140180 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.140416 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.140588 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.140727 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.140904 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.141050 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.141216 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.141364 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.141534 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.141692 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.141875 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.142057 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.142205 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.142422 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841782-1-iscsi {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.142556 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.142730 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.142874 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.143051 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.143187 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.143408 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.143498 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.143747 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.143836 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.144123 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.144210 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841782-1-iscsi {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.144437 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.144525 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.144778 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.144972 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.145122 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.145293 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.145428 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.145600 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.145749 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.145886 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.146019 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.146153 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.146315 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.146475 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.146618 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.146762 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.146905 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.147047 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.147218 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.147367 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.147526 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.147697 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.147834 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.147977 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.148140 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.148304 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.148452 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.148657 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.148801 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.148977 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.149126 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.149293 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.149435 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.149617 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.149759 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.149914 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.150059 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.150207 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.150424 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.150564 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.150711 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.150859 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.150995 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.151151 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.151308 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.151480 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.151644 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.151858 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.152022 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.152176 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.152311 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.152311 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.152577 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.152721 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.152874 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.152874 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.153139 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.153275 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.153425 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.153568 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.153708 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.153860 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.153995 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.154137 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.154284 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.154284 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.154548 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.154691 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.154824 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.154966 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.155112 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.155280 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.155428 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.155571 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.155716 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.155859 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.156006 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.156143 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.156277 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.156446 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.156601 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.156750 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.156884 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.157073 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.157215 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.157398 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.157547 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.157700 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.157841 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.158002 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.158152 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.158313 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.158467 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.158624 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.158767 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.158940 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.159088 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.159352 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.159500 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.159649 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.159783 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.159917 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.160051 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.160185 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.160403 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.160541 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.160688 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.160831 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.160964 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.161097 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.161239 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.161373 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.161519 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.161653 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.161787 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.162010 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.162161 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.162306 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.162441 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.162586 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.162729 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.162869 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.163016 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.163169 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.163320 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.163465 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.163608 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.163752 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.163894 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.164046 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.164181 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.164321 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.164455 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.164610 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.164747 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.164880 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.165021 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.165156 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.165306 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.165450 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.165586 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.165721 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.165864 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.165999 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.166149 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.166302 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.166444 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.166580 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.166712 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.166853 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.166995 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.167192 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.167345 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.167488 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.167634 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.167778 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.167915 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.168098 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.168241 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.168408 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.168550 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.168716 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.168859 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.169019 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.169161 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.169322 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.169464 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.169628 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.169778 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.169931 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.170065 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.170245 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.170384 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.170526 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.170673 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.170816 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.170962 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.171104 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.171278 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.171414 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.171557 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.171714 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.171867 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.172021 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.172224 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.172364 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.172507 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.172642 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.172782 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.172941 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.173083 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.173217 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.173363 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.173499 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.173633 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.173789 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.173933 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.174099 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.174248 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.174421 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.174571 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.174758 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.174915 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.175094 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.175298 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.175464 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.175606 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.175775 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.175915 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.176089 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.176233 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.176412 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:17:37.176567 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.176733 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.176883 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.177053 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.177202 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.177373 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.177522 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.177704 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.177858 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.178022 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.178172 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.178340 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.178483 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.178655 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.178813 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.178958 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.179091 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.179300 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.179442 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.179634 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.180282 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.180478 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.180619 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.180799 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.180960 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.181104 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.181325 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.181474 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.181616 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.181752 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.181893 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.182040 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.182187 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.182409 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.182557 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.182700 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.182835 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.182981 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.183182 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.183327 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.183493 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.183631 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.183766 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.183908 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.184060 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.184231 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.184380 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.184548 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.184690 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.184871 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.185013 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.185186 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.185329 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.185515 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.185669 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.185845 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.185986 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.186158 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.186300 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.186481 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.186623 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.186776 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.186912 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.187094 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.187261 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.187432 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.187601 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.187739 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.187921 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.188063 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.188245 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.188395 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.188572 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.188720 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.188888 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.189030 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.189206 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.189348 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.189509 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.189644 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.189826 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.189968 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.190145 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.190296 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.190487 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.190629 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.190794 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.190944 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.191086 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.191280 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.191417 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.191562 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.191720 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.191862 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.192029 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.192185 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.192354 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.192580 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.192720 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.192863 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.192999 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.193143 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.193285 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.193429 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.193575 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.193720 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.193887 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.194041 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.194186 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.194322 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.194501 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.194645 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.194813 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.194964 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.195147 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.195304 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.195543 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.195699 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.195844 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.195980 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.196669 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.196818 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.196981 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.197123 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.197291 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.197432 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.197601 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.197742 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.197919 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.198072 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.198217 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.198360 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.198527 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.198669 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.198845 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.198996 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.199169 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.199321 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.199458 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.199593 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.199790 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.199941 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.200087 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.200231 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.200394 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.200544 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.200715 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.200869 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.201013 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.201148 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.201332 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.201474 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.201649 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.201801 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.201966 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.202118 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.202292 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.202441 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.202603 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.202815 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.202955 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.203089 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.203274 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.203410 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.203557 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.203708 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.203845 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.203990 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.204125 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.204266 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.204413 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.204557 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.204692 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.204838 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.204973 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.205115 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.205259 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.205395 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.205560 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.205703 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.205857 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.206007 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.206175 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.206331 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.206474 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.206623 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.206776 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.206929 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.207072 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.207262 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.207407 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.207548 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.207715 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.207885 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.208029 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.208171 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.208352 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.208758 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.208928 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.209088 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.209231 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.209380 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.209521 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.209662 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.209847 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.209999 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.210163 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.210312 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.210455 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.210597 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.210812 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.210981 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.211185 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.211335 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.211476 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.211628 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.211779 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.211922 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.212063 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.212215 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.212357 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.212498 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.212648 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.212807 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.213019 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.213174 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.213327 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.213470 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.213620 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.213765 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.213906 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.214055 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.214207 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.214365 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.214511 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.214652 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.214794 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.214935 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.215084 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.215265 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.215410 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.215552 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.215701 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.215844 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.216003 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.216164 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.216308 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.216450 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.216591 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.216732 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.216874 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.217028 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.217172 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.217313 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.217462 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.217604 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.217754 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.217907 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.218048 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.218190 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.218354 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.218510 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.218666 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.218809 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.218956 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.219105 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.219309 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.219452 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.219604 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.219755 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.219907 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.220049 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.220196 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.220339 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.220514 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.220664 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.220812 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.220954 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.221122 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.221272 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.221445 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.221594 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.221742 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.221894 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.222036 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.222187 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.222331 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.222474 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.222620 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.222762 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.222911 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.223168 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.223322 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.223465 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.223606 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.223758 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.223899 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.224056 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.224207 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.224356 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.224511 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.224661 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.224802 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.224952 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.225094 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.225236 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.225386 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.225529 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.225703 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.225848 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.225997 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.226139 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.226280 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.226429 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.226603 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.226751 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.226893 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.227075 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.227263 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.227417 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.227570 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.227724 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.227866 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.228015 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.228158 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.228307 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.228458 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.228602 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.228743 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.228914 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.229062 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.229212 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.229354 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.229551 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.229710 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.229852 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.229993 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.230148 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.230291 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.230440 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.230592 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.230750 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.230989 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.231218 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.231369 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.231511 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.231660 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.231814 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.231957 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.232110 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.232253 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.232394 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.232535 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.232676 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.232838 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.232982 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.233141 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.233352 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.233508 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.233652 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.233816 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.233962 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.234111 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.234253 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.234402 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.234555 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.234705 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.234857 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.235001 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.235193 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.235344 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.235485 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.235653 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.235803 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.235947 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.236088 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.236230 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.236381 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.236524 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.236524 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.236801 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.236944 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.237086 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.237237 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.237379 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.237530 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.237671 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.237812 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.237953 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.238108 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.238264 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.238407 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.238547 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.238696 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.238847 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.239205 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.239374 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.239528 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.239681 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.239823 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.239964 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.240105 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.240256 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.240399 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.240542 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.240683 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.240832 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.240975 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.241125 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.241269 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.241456 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.241607 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.241807 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.241969 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.242121 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.242795 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.242983 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.243187 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.243358 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.243583 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.243740 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.243884 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.243884 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.244165 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.244314 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.244459 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.244617 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.244761 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.244909 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.245063 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.245212 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.245354 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.245510 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.245660 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.245808 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.245951 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.246102 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.246245 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.246400 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.246552 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.246695 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.246837 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.246977 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.247152 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.247152 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.247443 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.247595 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.247737 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.247879 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.248039 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.248183 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.248325 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.248466 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.248609 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.248759 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.248915 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.249059 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.249201 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.249342 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.249485 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.249628 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.249788 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.249939 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.250081 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.250223 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.250365 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.250518 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.250663 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.250805 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.250945 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.251086 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.251266 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.251421 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.251565 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.251718 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.251860 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.252002 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.252144 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.252295 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.252438 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.252579 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.252722 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.252864 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.253006 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.253164 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.253307 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.253455 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.253692 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.253843 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.253995 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.254138 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.254281 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.254431 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.254575 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.254717 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.254869 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.255013 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.255184 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.255334 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.255487 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.255630 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.255785 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.255930 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.256072 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.256214 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.256357 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.256498 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.256650 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.256793 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.256937 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.257078 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.257228 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.257389 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.257533 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.257675 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.257840 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.258016 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.258158 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.258315 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.258459 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.258601 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.258743 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.258884 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.259027 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.259222 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.259386 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.259529 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.259671 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.259812 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.259954 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.260111 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.260262 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.260405 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.260547 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.260688 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.260842 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.260985 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.261128 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.261286 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.261429 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.261571 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.261722 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.261864 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.262013 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.262164 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.262314 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.262455 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.262673 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.262818 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.262966 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.263108 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.263317 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.263461 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.263613 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.263837 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.263986 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.264138 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.264289 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.264440 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.264583 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.264725 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.264866 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.265007 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.265168 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.265321 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.265465 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.265607 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.265756 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.265898 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.265898 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.266175 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.266317 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.266461 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.266611 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.266754 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.266902 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.267066 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.267265 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.267409 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.267551 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.267692 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.267845 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.267995 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.268138 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.268279 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.268279 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.268556 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.268712 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.268855 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.269007 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.269149 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.269299 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.269442 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.269594 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.269738 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.269879 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.270019 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.270161 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.270340 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.270496 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.270641 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.270790 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.270944 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.271086 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.271256 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.271410 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.271560 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.271704 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.271853 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.271996 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.272149 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.272299 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.272443 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.272584 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.272729 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.272880 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.273031 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.273174 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.273316 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.273976 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.274200 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.274349 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.274503 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.274646 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.274789 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.275088 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.275274 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.275429 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.275727 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.275878 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.276028 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.276299 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.276447 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.276637 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.276889 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.277017 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.277241 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.277471 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.277573 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.277836 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.278057 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.278156 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.278448 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.278656 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.278877 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.279222 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.279396 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.279559 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.279707 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.279854 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.280003 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.280165 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.280325 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.280464 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.280616 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.280760 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.280918 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.281060 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.281153 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.281306 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.281440 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.281722 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.281821 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.282035 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.282124 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.282346 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.282436 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.282658 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.282756 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.282963 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.283053 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.283297 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.283446 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.283624 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.283772 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.283944 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.284079 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.284263 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.284415 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.284558 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.284690 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.284823 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.285008 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.285143 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.285328 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.285471 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.285644 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.285772 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.285965 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.286131 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.286288 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.286460 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.286606 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.286747 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.286889 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.287169 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.287352 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.287534 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.287684 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.287816 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.287957 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.288068 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.288279 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.288371 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.288599 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.288687 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.288912 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.289001 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.289802 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.289903 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.290121 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.290210 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.290446 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.290535 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.290758 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.290847 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.291068 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.291187 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.291410 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.291505 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.291723 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.291820 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.292039 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.292130 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.292359 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.292466 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.292673 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.292776 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.292994 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.293092 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.293439 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.293540 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.293723 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.293822 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.294036 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.294126 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.294362 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.294452 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.294690 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.294788 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.294997 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.295086 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.295329 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.295429 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.295652 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.295752 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.295964 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.296054 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.296277 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.296450 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.296598 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.296751 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.296896 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.297038 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.297199 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.297421 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.297579 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.297723 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.297867 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.298009 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.298151 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.298294 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.298447 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.298590 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.298733 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.298876 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.299019 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.299193 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.299353 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.299498 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.299641 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.299830 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.299981 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.300149 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.300309 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.300481 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.300632 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.300814 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.300966 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.301121 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.301273 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.301415 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.301557 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.301700 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.301843 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.301994 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.302146 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.302316 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.302474 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.302618 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.302762 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.302913 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.303058 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.303248 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.303421 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.303576 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.303720 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.303909 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.304053 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.304197 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.304345 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.304489 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.304639 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.304809 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.304953 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.305106 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.305249 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.305420 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.305579 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.305723 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.305864 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.306006 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.306157 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.306308 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.306464 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.306615 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.306765 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.306909 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.307069 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.307250 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.307424 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.307635 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.307783 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.307925 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.308066 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.308223 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.308374 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.308517 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.308659 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.308801 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.308942 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.309103 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.309247 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.309397 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.309540 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.309682 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.309823 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.309973 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.310125 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.310268 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.310410 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.310553 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.310771 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.310916 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.311072 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.311251 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.311397 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.311540 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.311690 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.311834 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.311976 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.312117 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.312268 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.312421 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.312573 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.312724 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.312877 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.313019 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.313161 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.313303 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.313455 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.313599 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.313742 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.313883 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.314032 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.314183 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.314335 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.314486 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.314630 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.314782 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.314931 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.315082 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.315250 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.315393 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.315671 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.315978 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.316132 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.316284 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.316427 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.316682 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.316840 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.316993 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.317155 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.317308 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.317459 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.317627 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.317841 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.317989 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.318209 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.318362 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.318513 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.318665 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.318818 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.318963 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.319114 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.319348 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.319492 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.319634 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.319775 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.319925 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.320078 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.320221 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.320403 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.320548 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.320727 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.320884 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.321036 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.321196 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.321346 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.321498 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.321641 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.321798 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.321950 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.322100 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.322250 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.322400 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.322543 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.322693 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.322844 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.323005 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.323165 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.323325 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.323469 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.323656 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.323805 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.323948 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.324134 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.324292 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.324444 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.324587 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.324763 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.324931 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.325083 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.325225 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.325375 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.325517 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.325695 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.325854 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.326003 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.326154 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.326310 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.326460 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.326611 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.326765 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.326925 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.327084 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.327285 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.327429 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.327572 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.327726 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.327948 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.328106 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.328251 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.328393 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.328535 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.328676 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.328853 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.329015 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.329160 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.329303 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.329480 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.329629 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.329844 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.329996 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.330166 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.330317 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.330466 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.330616 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.330778 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.330921 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.331156 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.331320 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.331467 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.331627 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.331772 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.331922 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.332064 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.332207 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.332349 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.332502 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.332647 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.332804 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.332947 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.333089 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.333231 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.333629 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.333780 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.333922 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.334091 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.334241 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.334421 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.334579 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.334760 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.334957 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.335108 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.335338 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.335500 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.335645 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.335786 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.336479 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.336638 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.336813 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.337061 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.337212 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.337386 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.337540 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.337734 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.337893 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.338129 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.338278 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.338421 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.338563 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.338706 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.338862 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.339007 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.339178 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.339337 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.339482 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.339635 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.339787 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.339932 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.340082 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.340225 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.340375 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.340525 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.340677 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.340822 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.340964 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.341106 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.341248 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.341397 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.341558 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.341702 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.341853 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.341996 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.342139 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.342294 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.342438 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.342580 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.342788 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.342937 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.343080 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.343288 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.343442 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.343596 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.343745 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.343895 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.344047 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.344203 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.344348 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.344490 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.344632 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.344774 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.344922 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.345099 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.345257 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.345408 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.345568 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.345711 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.345866 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.346010 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.346153 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.346323 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.346472 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.346635 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.346797 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.346940 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.347083 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.347272 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.347428 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.347581 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.347800 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.347945 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.348196 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.348351 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.348503 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.348646 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.348801 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.348945 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.349087 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.349262 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.349408 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.349574 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.349718 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.349862 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.350004 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.350152 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.350327 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.350486 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.350631 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.350773 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.350916 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.351066 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.351242 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.351439 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.351651 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.351803 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.351946 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.352089 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.352231 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.352871 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.353019 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.353169 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.353312 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.353455 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.353610 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.353754 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.353907 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.354057 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.354208 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.354351 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.354502 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.354646 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.354797 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.354947 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.355088 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.355267 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.355420 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.355572 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.355716 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.355875 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.356018 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.356160 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.356312 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.356455 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.356598 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.356752 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.356896 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.357049 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.357193 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.357334 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.357475 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.357769 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.357929 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.358081 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.358251 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.358462 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.358611 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.358760 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.358911 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.359064 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.359233 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.359327 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.359445 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.359622 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.359758 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.359953 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.360071 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.360271 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.360419 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.360581 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.360720 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.361006 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.361105 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.361322 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.361426 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.361640 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.361737 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.361956 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.362045 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.362266 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.362355 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.362577 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.362692 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.362895 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.362988 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.363229 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.363335 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.363545 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.363634 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.363858 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.363970 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.364173 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.364274 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.364489 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.364580 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.364830 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.364919 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.365150 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.365238 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.365454 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.365543 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.365762 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.365915 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.366068 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.366168 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.366382 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.366475 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.366703 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.366792 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.367019 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.367143 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.367371 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.367460 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.367677 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.367767 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.367989 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.368099 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.368295 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.368385 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.368607 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.368697 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.368914 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.369030 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.369221 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.369349 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.369531 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.369676 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.369835 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.370005 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.370140 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.370323 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.370461 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.370650 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.370749 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.370978 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.371075 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.371320 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.371423 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.371639 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.371729 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.371943 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.372032 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.372251 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.372341 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.372556 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.372647 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.372861 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.372950 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.373167 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.373255 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.373501 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.373592 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.373834 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.373931 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.374146 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.374245 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.374466 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.374575 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.374771 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.374860 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.375091 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.375228 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.375427 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.375517 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.375752 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.375849 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.376073 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.376175 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.376391 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.376482 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.376701 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.376791 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.377024 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.377242 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.377331 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.377413 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.377624 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.377721 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.377932 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.378031 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.378241 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.378329 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.378547 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.378680 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.378855 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.378952 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.379183 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.379276 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.379496 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.379585 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.379807 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.379897 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.380111 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.380199 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.380421 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.380510 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.380730 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.380821 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.381038 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.381126 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.381346 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.381444 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.381671 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.381771 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.381984 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.382073 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.382296 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.382394 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.382612 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.382692 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.382946 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.383044 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.383301 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.383411 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.383623 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.383711 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.383941 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.384030 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.384270 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.384408 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.384591 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.384690 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.384899 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.384987 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.385227 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.385318 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.385540 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.385628 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.385861 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.385951 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.386178 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.386269 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.386496 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.386586 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.386813 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.386910 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.387152 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.387258 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.387464 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.387553 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.387773 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.387872 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.388019 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102950) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 17:17:37.388118 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.388407 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.388730 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.389056 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.389379 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.389697 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.390030 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.390347 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.390664 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.390984 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.391322 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.391645 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.391969 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.392291 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.392623 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.392955 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.393274 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.393606 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.393938 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.394293 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.394612 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.394961 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.395321 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.395645 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.395962 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.396275 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:17:37.396522 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=102949) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 17:17:37.412099 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG oslo_db.sqlalchemy.engines [None req-c2c7a3aa-7c65-4b45-a6d2-80e1588f9674 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 17:17:37.420331 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG oslo_db.sqlalchemy.engines [None req-10d1b246-4f7c-4e01-8f78-976a6bbcc6a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 17:17:37.478157 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.context [None req-c2c7a3aa-7c65-4b45-a6d2-80e1588f9674 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b14dab8a-67db-465f-b07a-be88db818145(cell1) {{(pid=102950) load_cells /opt/stack/nova/nova/context.py:464}} May 13 17:17:37.482535 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG oslo_concurrency.lockutils [None req-c2c7a3aa-7c65-4b45-a6d2-80e1588f9674 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:17:37.484180 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG oslo_concurrency.lockutils [None req-c2c7a3aa-7c65-4b45-a6d2-80e1588f9674 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:17:37.484680 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.context [None req-10d1b246-4f7c-4e01-8f78-976a6bbcc6a7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b14dab8a-67db-465f-b07a-be88db818145(cell1) {{(pid=102949) load_cells /opt/stack/nova/nova/context.py:464}} May 13 17:17:37.484974 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG oslo_concurrency.lockutils [None req-c2c7a3aa-7c65-4b45-a6d2-80e1588f9674 None None] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:17:37.486903 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG oslo_concurrency.lockutils [None req-c2c7a3aa-7c65-4b45-a6d2-80e1588f9674 None None] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:17:37.488984 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG oslo_concurrency.lockutils [None req-10d1b246-4f7c-4e01-8f78-976a6bbcc6a7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:17:37.490606 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG oslo_concurrency.lockutils [None req-10d1b246-4f7c-4e01-8f78-976a6bbcc6a7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:17:37.491442 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG oslo_concurrency.lockutils [None req-10d1b246-4f7c-4e01-8f78-976a6bbcc6a7 None None] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:17:37.493528 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG oslo_concurrency.lockutils [None req-10d1b246-4f7c-4e01-8f78-976a6bbcc6a7 None None] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=102949) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:17:37.498723 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG oslo_db.sqlalchemy.engines [None req-c2c7a3aa-7c65-4b45-a6d2-80e1588f9674 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 17:17:37.503031 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG oslo_db.sqlalchemy.engines [None req-c2c7a3aa-7c65-4b45-a6d2-80e1588f9674 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 17:17:37.513092 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG oslo_db.sqlalchemy.engines [None req-10d1b246-4f7c-4e01-8f78-976a6bbcc6a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 17:17:37.515169 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG oslo_db.sqlalchemy.engines [None req-10d1b246-4f7c-4e01-8f78-976a6bbcc6a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 17:17:37.668426 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG oslo_db.sqlalchemy.engines [None req-c2c7a3aa-7c65-4b45-a6d2-80e1588f9674 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102950) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 17:17:37.676196 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG oslo_db.sqlalchemy.engines [None req-10d1b246-4f7c-4e01-8f78-976a6bbcc6a7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102949) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 17:17:38.104860 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: WARNING keystonemiddleware.auth_token [None req-c2c7a3aa-7c65-4b45-a6d2-80e1588f9674 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 17:17:38.112340 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: WARNING keystonemiddleware.auth_token [None req-c2c7a3aa-7c65-4b45-a6d2-80e1588f9674 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 17:17:38.140261 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: WARNING keystonemiddleware.auth_token [None req-10d1b246-4f7c-4e01-8f78-976a6bbcc6a7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 17:17:38.149113 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: WARNING keystonemiddleware.auth_token [None req-10d1b246-4f7c-4e01-8f78-976a6bbcc6a7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 17:17:38.457187 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: WARNING keystonemiddleware.auth_token [None req-c2c7a3aa-7c65-4b45-a6d2-80e1588f9674 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 17:17:38.464165 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: WARNING keystonemiddleware.auth_token [None req-c2c7a3aa-7c65-4b45-a6d2-80e1588f9674 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 17:17:38.470155 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557e28fc99c0 pid: 102950 (default app) May 13 17:17:38.472247 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-c2c7a3aa-7c65-4b45-a6d2-80e1588f9674 None None] Calling method '>' {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:17:38.473415 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-c2c7a3aa-7c65-4b45-a6d2-80e1588f9674 None None] 10.222.0.64 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001737 May 13 17:17:38.473827 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 788 bytes} [Fri May 13 17:17:38 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:17:38.490805 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: WARNING keystonemiddleware.auth_token [None req-10d1b246-4f7c-4e01-8f78-976a6bbcc6a7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 17:17:38.498432 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: WARNING keystonemiddleware.auth_token [None req-10d1b246-4f7c-4e01-8f78-976a6bbcc6a7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 17:17:38.503517 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x557e28fc99c0 pid: 102949 (default app) May 13 17:19:00.347882 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-c2c7a3aa-7c65-4b45-a6d2-80e1588f9674 None None] Calling method '>' {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:00.348871 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-c2c7a3aa-7c65-4b45-a6d2-80e1588f9674 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 May 13 17:19:00.349429 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 2/2] 10.222.0.64 () {54 vars in 930 bytes} [Fri May 13 17:19:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:19:00.800036 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-1c37d2cc-e833-48a5-996a-19e89796ec8c admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:00.829284 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-1c37d2cc-e833-48a5-996a-19e89796ec8c admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.473218 May 13 17:19:00.830115 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 1/3] 10.222.0.64 () {60 vars in 1291 bytes} [Fri May 13 17:19:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:19:03.117137 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-c2c7a3aa-7c65-4b45-a6d2-80e1588f9674 None None] Calling method '>' {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:03.118697 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-c2c7a3aa-7c65-4b45-a6d2-80e1588f9674 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002009 May 13 17:19:03.119293 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 3/4] 10.222.0.64 () {54 vars in 930 bytes} [Fri May 13 17:19:03 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:19:03.180008 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-f5796d60-2fc0-4eb5-9dae-72a64ef695e0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "cirros256", "swap": 0, "id": "c1", "ram": 256, "disk": 1, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:19:03.200941 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 17:19:03.200941 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: warnings.warn(msg) May 13 17:19:03.305207 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-f5796d60-2fc0-4eb5-9dae-72a64ef695e0 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.179853 May 13 17:19:03.305955 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 2/5] 10.222.0.64 () {64 vars in 1282 bytes} [Fri May 13 17:19:03 2022] POST /compute/v2.1/flavors => generated 407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 17:19:03.550012 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-1c65f3a9-15e9-43ae-aff1-5927dd13795e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:19:03.552601 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 17:19:03.552601 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: warnings.warn(msg) May 13 17:19:03.667358 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-1c65f3a9-15e9-43ae-aff1-5927dd13795e admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.353157 May 13 17:19:03.668030 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 4/6] 10.222.0.64 () {64 vars in 1335 bytes} [Fri May 13 17:19:03 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:19:05.967372 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-f5796d60-2fc0-4eb5-9dae-72a64ef695e0 admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:05.968385 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-f5796d60-2fc0-4eb5-9dae-72a64ef695e0 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 May 13 17:19:05.968789 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 3/7] 10.222.0.64 () {54 vars in 930 bytes} [Fri May 13 17:19:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:19:06.071772 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-914ecc05-8e8c-46d5-9e5a-76355deffdeb admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds512M", "os-flavor-access:is_public": true, "vcpus": 1, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "swap": 0, "id": "d1"}} {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:19:06.089639 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 17:19:06.089639 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: warnings.warn(msg) May 13 17:19:06.196916 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-914ecc05-8e8c-46d5-9e5a-76355deffdeb admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.222173 May 13 17:19:06.197592 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 5/8] 10.222.0.64 () {64 vars in 1282 bytes} [Fri May 13 17:19:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 17:19:06.214382 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-00e91080-34bf-4864-9d1c-bedef27a115e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:19:06.215915 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 17:19:06.215915 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: warnings.warn(msg) May 13 17:19:06.349796 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-00e91080-34bf-4864-9d1c-bedef27a115e admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.139690 May 13 17:19:06.350324 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 4/9] 10.222.0.64 () {64 vars in 1335 bytes} [Fri May 13 17:19:06 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:19:08.768257 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-914ecc05-8e8c-46d5-9e5a-76355deffdeb admin admin] Calling method '>' {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:08.769283 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-914ecc05-8e8c-46d5-9e5a-76355deffdeb admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 May 13 17:19:08.769701 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 6/10] 10.222.0.64 () {54 vars in 930 bytes} [Fri May 13 17:19:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:19:08.830704 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-6f76a367-6c80-4fc4-85e6-50f7c91a820e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds1G", "id": "d2", "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024}} {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:19:08.918358 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-6f76a367-6c80-4fc4-85e6-50f7c91a820e admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141952 May 13 17:19:08.919243 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 5/11] 10.222.0.64 () {64 vars in 1282 bytes} [Fri May 13 17:19:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 17:19:08.930909 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-cc4ae218-999f-458e-bbfe-2062a547a35c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:19:09.030271 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-cc4ae218-999f-458e-bbfe-2062a547a35c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098944 May 13 17:19:09.030271 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 7/12] 10.222.0.64 () {64 vars in 1335 bytes} [Fri May 13 17:19:08 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:19:11.306913 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-6f76a367-6c80-4fc4-85e6-50f7c91a820e admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:11.307957 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-6f76a367-6c80-4fc4-85e6-50f7c91a820e admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 May 13 17:19:11.308362 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 6/13] 10.222.0.64 () {54 vars in 930 bytes} [Fri May 13 17:19:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:19:11.369848 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-2d117774-6d66-48c2-b088-dd8271c8a165 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "id": "d3", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "ram": 2048, "disk": 10, "os-flavor-access:is_public": true}} {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:19:11.442838 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-2d117774-6d66-48c2-b088-dd8271c8a165 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.128806 May 13 17:19:11.443462 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 8/14] 10.222.0.64 () {64 vars in 1282 bytes} [Fri May 13 17:19:11 2022] POST /compute/v2.1/flavors => generated 404 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 17:19:11.455698 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-093047b7-7eff-4b16-95ed-77fb6a194324 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:19:11.520927 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-093047b7-7eff-4b16-95ed-77fb6a194324 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.069022 May 13 17:19:11.521520 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 7/15] 10.222.0.64 () {64 vars in 1335 bytes} [Fri May 13 17:19:11 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:19:13.803508 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-2d117774-6d66-48c2-b088-dd8271c8a165 admin admin] Calling method '>' {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:13.804525 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-2d117774-6d66-48c2-b088-dd8271c8a165 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 May 13 17:19:13.805485 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 9/16] 10.222.0.64 () {54 vars in 930 bytes} [Fri May 13 17:19:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:19:13.864178 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-44aed953-83d8-4ffd-8d85-98a13df76107 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 4096, "vcpus": 4, "swap": 0, "disk": 20, "id": "d4", "os-flavor-access:is_public": true, "name": "ds4G"}} {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:19:13.950995 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-44aed953-83d8-4ffd-8d85-98a13df76107 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.139825 May 13 17:19:13.951578 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 8/17] 10.222.0.64 () {64 vars in 1282 bytes} [Fri May 13 17:19:13 2022] POST /compute/v2.1/flavors => generated 404 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 17:19:13.964858 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-b9fab66f-79ec-489a-8a3d-82b0e4e3a977 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:19:14.074349 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-b9fab66f-79ec-489a-8a3d-82b0e4e3a977 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114822 May 13 17:19:14.075529 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 10/18] 10.222.0.64 () {64 vars in 1335 bytes} [Fri May 13 17:19:13 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:19:16.365881 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-44aed953-83d8-4ffd-8d85-98a13df76107 admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:16.366960 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-44aed953-83d8-4ffd-8d85-98a13df76107 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 May 13 17:19:16.368365 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 9/19] 10.222.0.64 () {54 vars in 930 bytes} [Fri May 13 17:19:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:19:16.424670 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-074bec5a-c686-481d-8191-06309788b4e9 admin admin] Calling method '>' {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:16.450159 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-074bec5a-c686-481d-8191-06309788b4e9 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.075562 May 13 17:19:16.450927 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 11/20] 10.222.0.64 () {60 vars in 1291 bytes} [Fri May 13 17:19:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:19:19.103094 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-44aed953-83d8-4ffd-8d85-98a13df76107 admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:19.104280 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-44aed953-83d8-4ffd-8d85-98a13df76107 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001627 May 13 17:19:19.104711 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 10/21] 10.222.0.64 () {54 vars in 930 bytes} [Fri May 13 17:19:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:19:19.165254 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-87824835-080b-4b78-8ad5-9e04c777194c admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "os-flavor-access:is_public": true, "id": "1", "name": "m1.tiny"}} {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:19:19.288212 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-87824835-080b-4b78-8ad5-9e04c777194c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.177076 May 13 17:19:19.288642 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 12/22] 10.222.0.64 () {64 vars in 1282 bytes} [Fri May 13 17:19:19 2022] POST /compute/v2.1/flavors => generated 402 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 17:19:19.300235 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-bad24d71-13b0-4ba9-9676-c55169454d00 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:19:19.402478 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-bad24d71-13b0-4ba9-9676-c55169454d00 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105767 May 13 17:19:19.403273 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 11/23] 10.222.0.64 () {64 vars in 1332 bytes} [Fri May 13 17:19:19 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:19:21.654911 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-87824835-080b-4b78-8ad5-9e04c777194c admin admin] Calling method '>' {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:21.655949 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-87824835-080b-4b78-8ad5-9e04c777194c admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 May 13 17:19:21.656349 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 13/24] 10.222.0.64 () {54 vars in 930 bytes} [Fri May 13 17:19:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:19:21.719972 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-a1108047-f2c5-48b2-ba10-c1e11b2ab68b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 2048}} {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:19:21.785669 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-a1108047-f2c5-48b2-ba10-c1e11b2ab68b admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.123363 May 13 17:19:21.786668 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 12/25] 10.222.0.64 () {64 vars in 1282 bytes} [Fri May 13 17:19:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 17:19:21.798204 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-3ab5b638-d009-47b5-b03d-cd10879c673d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:19:21.886803 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-3ab5b638-d009-47b5-b03d-cd10879c673d admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092004 May 13 17:19:21.887508 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 14/26] 10.222.0.64 () {64 vars in 1332 bytes} [Fri May 13 17:19:21 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:19:24.198648 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-a1108047-f2c5-48b2-ba10-c1e11b2ab68b admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:24.199693 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-a1108047-f2c5-48b2-ba10-c1e11b2ab68b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 May 13 17:19:24.200094 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 13/27] 10.222.0.64 () {54 vars in 930 bytes} [Fri May 13 17:19:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:19:24.257478 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-4011032f-6010-4d39-a051-dd6302148b66 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "m1.medium", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "3", "swap": 0, "ram": 4096, "vcpus": 2}} {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:19:24.383897 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-4011032f-6010-4d39-a051-dd6302148b66 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.177653 May 13 17:19:24.384625 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 15/28] 10.222.0.64 () {64 vars in 1282 bytes} [Fri May 13 17:19:24 2022] POST /compute/v2.1/flavors => generated 406 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 17:19:24.396344 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-7cd3fcb1-3bb4-4291-8ca4-590cab7492ce admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:19:24.543930 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-7cd3fcb1-3bb4-4291-8ca4-590cab7492ce admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.151175 May 13 17:19:24.544441 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 14/29] 10.222.0.64 () {64 vars in 1332 bytes} [Fri May 13 17:19:24 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:19:26.821600 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-4011032f-6010-4d39-a051-dd6302148b66 admin admin] Calling method '>' {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:26.822620 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-4011032f-6010-4d39-a051-dd6302148b66 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 May 13 17:19:26.823022 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 16/30] 10.222.0.64 () {54 vars in 930 bytes} [Fri May 13 17:19:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:19:26.881943 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-7ab3dbc3-7f4b-42f3-a3d1-14085147a559 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.large", "ram": 8192, "id": "4", "disk": 80}} {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:19:26.951752 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-7ab3dbc3-7f4b-42f3-a3d1-14085147a559 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.122458 May 13 17:19:26.952604 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 15/31] 10.222.0.64 () {64 vars in 1282 bytes} [Fri May 13 17:19:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 17:19:26.965957 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-5da07dbc-a2e9-4fe7-82fa-7d7128478917 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:19:27.057758 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-5da07dbc-a2e9-4fe7-82fa-7d7128478917 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096063 May 13 17:19:27.058925 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 17/32] 10.222.0.64 () {64 vars in 1332 bytes} [Fri May 13 17:19:26 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:19:29.352723 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-7ab3dbc3-7f4b-42f3-a3d1-14085147a559 admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:29.354387 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-7ab3dbc3-7f4b-42f3-a3d1-14085147a559 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002578 May 13 17:19:29.359592 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 16/33] 10.222.0.64 () {54 vars in 930 bytes} [Fri May 13 17:19:29 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:19:29.455618 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-08de1ea5-5fbf-4604-ba58-bdf434e5b9bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "rxtx_factor": 1.0, "name": "m1.xlarge", "vcpus": 8, "os-flavor-access:is_public": true, "id": "5", "swap": 0}} {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:19:29.546034 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-08de1ea5-5fbf-4604-ba58-bdf434e5b9bf admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.184510 May 13 17:19:29.546505 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 18/34] 10.222.0.64 () {64 vars in 1282 bytes} [Fri May 13 17:19:29 2022] POST /compute/v2.1/flavors => generated 408 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 17:19:29.558593 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-696f8ab3-85bf-4f3e-a545-54061f30fa88 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:19:29.634928 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-696f8ab3-85bf-4f3e-a545-54061f30fa88 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080466 May 13 17:19:29.635716 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 17/35] 10.222.0.64 () {64 vars in 1332 bytes} [Fri May 13 17:19:29 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:19:53.384810 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-08de1ea5-5fbf-4604-ba58-bdf434e5b9bf admin admin] Calling method '>' {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:53.386537 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-08de1ea5-5fbf-4604-ba58-bdf434e5b9bf admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002586 May 13 17:19:53.387047 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 19/36] 10.222.0.64 () {54 vars in 930 bytes} [Fri May 13 17:19:53 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:19:53.444358 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-e103852f-e4b4-43f6-82c6-3575af132b1e admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:53.461776 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-e103852f-e4b4-43f6-82c6-3575af132b1e admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.068506 May 13 17:19:53.462304 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 18/37] 10.222.0.64 () {60 vars in 1291 bytes} [Fri May 13 17:19:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:19:54.461657 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-08de1ea5-5fbf-4604-ba58-bdf434e5b9bf admin admin] Calling method '>' {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:54.462684 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-08de1ea5-5fbf-4604-ba58-bdf434e5b9bf admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001712 May 13 17:19:54.463104 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 20/38] 10.222.0.64 () {56 vars in 1074 bytes} [Fri May 13 17:19:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:19:54.662491 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-dc94cda7-eb0e-4fb5-84fa-24024e793bc5 admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:54.668552 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.wsgi [None req-dc94cda7-eb0e-4fb5-84fa-24024e793bc5 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 13 17:19:54.671814 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-dc94cda7-eb0e-4fb5-84fa-24024e793bc5 admin admin] Request method failure captured: May 13 17:19:54.671814 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 13 17:19:54.671814 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: Accept: application/json May 13 17:19:54.671814 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: Accept-Encoding: gzip, deflate May 13 17:19:54.671814 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: Connection: keep-alive May 13 17:19:54.671814 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: Content-Length: 0 May 13 17:19:54.671814 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: Host: 10.222.0.64 May 13 17:19:54.671814 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: Openstack-Api-Version: compute 2.90 May 13 17:19:54.671814 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: Openstack-System-Scope: None May 13 17:19:54.671814 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: User-Agent: python-novaclient May 13 17:19:54.671814 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Auth-Token: gAAAAABifpM6A2elgbedl0QRCitBT-gql0eKUuEPQBTMYlvM1LNkY_cLaDXmIzHPh5bbC_MPAIoplF3gchCNaELrjykFHrWxsg4Q2gihd-6uaFK9hyGlpKzXCWkOOwMhxNj6-1xgTyvusX-sPkJ4lLDSd3P18nVrMtlPNkBakSh-Kmp80RNgXls May 13 17:19:54.671814 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Domain-Id: None May 13 17:19:54.671814 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Domain-Name: None May 13 17:19:54.671814 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Identity-Status: Confirmed May 13 17:19:54.671814 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Is-Admin-Project: True May 13 17:19:54.671814 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Openstack-Nova-Api-Version: 2.90 May 13 17:19:54.671814 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Project-Domain-Id: default May 13 17:19:54.671814 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Project-Domain-Name: Default May 13 17:19:54.671814 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Project-Id: 6e1067556b2a41588af4e1e6fd0de9f1 May 13 17:19:54.671814 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Project-Name: admin May 13 17:19:54.671814 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Role: reader,admin,member May 13 17:19:54.671814 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Roles: reader,admin,member May 13 17:19:54.673307 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6e1067556b2a41588af4e1e6fd0de9f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6e1067556b2a41588af4e1e6fd0de9f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6e1067556b2a41588af4e1e6fd0de9f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6e1067556b2a41588af4e1e6fd0de9f1"}]}] May 13 17:19:54.673307 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Tenant: admin May 13 17:19:54.673307 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Tenant-Id: 6e1067556b2a41588af4e1e6fd0de9f1 May 13 17:19:54.673307 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Tenant-Name: admin May 13 17:19:54.673307 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-User: admin May 13 17:19:54.673307 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-User-Domain-Id: default May 13 17:19:54.673307 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-User-Domain-Name: Default May 13 17:19:54.673307 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-User-Id: 3163ceb80e1143e28503836c92928e92 May 13 17:19:54.673307 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-User-Name: admin May 13 17:19:54.673307 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: method: > May 13 17:19:54.673307 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: exception: Flavor 42 could not be found. May 13 17:19:54.673307 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: action_args: {'id': '42'} May 13 17:19:54.673307 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:19:54.673307 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:19:54.674249 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 17:19:54.674249 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 17:19:54.674249 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 17:19:54.674249 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 17:19:54.674249 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 17:19:54.674249 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 17:19:54.674249 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 17:19:54.674249 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 17:19:54.674249 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 17:19:54.674249 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:19:54.674249 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 17:19:54.674249 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 17:19:54.674249 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 13 17:19:54.674249 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi May 13 17:19:54.674249 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:19:54.674249 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi May 13 17:19:54.674249 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:19:54.674249 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:19:54.674249 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:19:54.675568 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:19:54.675568 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:19:54.675568 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:19:54.675568 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:19:54.675568 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 17:19:54.675568 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 17:19:54.675568 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 13 17:19:54.675568 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi May 13 17:19:54.675568 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:19:54.675568 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi May 13 17:19:54.675568 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:19:54.675568 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:19:54.675568 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:19:54.675568 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:19:54.675568 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:19:54.675568 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 13 17:19:54.675568 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi May 13 17:19:54.675568 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-dc94cda7-eb0e-4fb5-84fa-24024e793bc5 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:19:54.676642 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-dc94cda7-eb0e-4fb5-84fa-24024e793bc5 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060557 May 13 17:19:54.676642 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 19/39] 10.222.0.64 () {60 vars in 1190 bytes} [Fri May 13 17:19:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 17:19:54.683647 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-cd5c7df5-f29d-4c26-88b2-80523a3b60ee admin admin] Calling method '>' {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:54.704868 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-cd5c7df5-f29d-4c26-88b2-80523a3b60ee admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025652 May 13 17:19:54.705391 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 21/40] 10.222.0.64 () {60 vars in 1210 bytes} [Fri May 13 17:19:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:19:54.715141 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-cffce3e8-9156-4e99-9708-bc40bc2ef99a admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:54.736360 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-cffce3e8-9156-4e99-9708-bc40bc2ef99a admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024786 May 13 17:19:54.736912 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 20/41] 10.222.0.64 () {60 vars in 1210 bytes} [Fri May 13 17:19:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:19:54.746430 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-057b2cbf-985b-47bc-b479-865c2a67a15f admin admin] Calling method '>' {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:54.751846 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.wsgi [None req-057b2cbf-985b-47bc-b479-865c2a67a15f admin admin] HTTP exception thrown: Flavor 42 could not be found. May 13 17:19:54.755028 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-057b2cbf-985b-47bc-b479-865c2a67a15f admin admin] Request method failure captured: May 13 17:19:54.755028 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 13 17:19:54.755028 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: Accept: application/json May 13 17:19:54.755028 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: Accept-Encoding: gzip, deflate May 13 17:19:54.755028 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: Connection: keep-alive May 13 17:19:54.755028 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: Content-Length: 0 May 13 17:19:54.755028 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: Host: 10.222.0.64 May 13 17:19:54.755028 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: Openstack-Api-Version: compute 2.90 May 13 17:19:54.755028 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: Openstack-System-Scope: None May 13 17:19:54.755028 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: User-Agent: python-novaclient May 13 17:19:54.755028 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Auth-Token: gAAAAABifpM6A2elgbedl0QRCitBT-gql0eKUuEPQBTMYlvM1LNkY_cLaDXmIzHPh5bbC_MPAIoplF3gchCNaELrjykFHrWxsg4Q2gihd-6uaFK9hyGlpKzXCWkOOwMhxNj6-1xgTyvusX-sPkJ4lLDSd3P18nVrMtlPNkBakSh-Kmp80RNgXls May 13 17:19:54.755028 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Domain-Id: None May 13 17:19:54.755028 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Domain-Name: None May 13 17:19:54.755028 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Identity-Status: Confirmed May 13 17:19:54.755028 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Is-Admin-Project: True May 13 17:19:54.755028 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Openstack-Nova-Api-Version: 2.90 May 13 17:19:54.755028 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Project-Domain-Id: default May 13 17:19:54.755028 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Project-Domain-Name: Default May 13 17:19:54.755028 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Project-Id: 6e1067556b2a41588af4e1e6fd0de9f1 May 13 17:19:54.755028 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Project-Name: admin May 13 17:19:54.755028 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Role: reader,admin,member May 13 17:19:54.755028 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Roles: reader,admin,member May 13 17:19:54.756601 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6e1067556b2a41588af4e1e6fd0de9f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6e1067556b2a41588af4e1e6fd0de9f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6e1067556b2a41588af4e1e6fd0de9f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6e1067556b2a41588af4e1e6fd0de9f1"}]}] May 13 17:19:54.756601 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Tenant: admin May 13 17:19:54.756601 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Tenant-Id: 6e1067556b2a41588af4e1e6fd0de9f1 May 13 17:19:54.756601 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Tenant-Name: admin May 13 17:19:54.756601 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-User: admin May 13 17:19:54.756601 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-User-Domain-Id: default May 13 17:19:54.756601 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-User-Domain-Name: Default May 13 17:19:54.756601 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-User-Id: 3163ceb80e1143e28503836c92928e92 May 13 17:19:54.756601 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-User-Name: admin May 13 17:19:54.756601 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: method: > May 13 17:19:54.756601 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: exception: Flavor 42 could not be found. May 13 17:19:54.756601 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: action_args: {'id': '42'} May 13 17:19:54.756601 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:19:54.756601 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:19:54.757582 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 17:19:54.757582 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 17:19:54.757582 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 17:19:54.757582 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 17:19:54.757582 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 17:19:54.757582 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 17:19:54.757582 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 17:19:54.757582 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 17:19:54.757582 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 17:19:54.757582 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:19:54.757582 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 17:19:54.757582 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 17:19:54.757582 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 13 17:19:54.757582 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi May 13 17:19:54.757582 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:19:54.757582 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi May 13 17:19:54.757582 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:19:54.757582 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:19:54.757582 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:19:54.758889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:19:54.758889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:19:54.758889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:19:54.758889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:19:54.758889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 17:19:54.758889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 17:19:54.758889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 13 17:19:54.758889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi May 13 17:19:54.758889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:19:54.758889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi May 13 17:19:54.758889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:19:54.758889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:19:54.758889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:19:54.758889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:19:54.758889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:19:54.758889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 13 17:19:54.758889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi May 13 17:19:54.758889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-057b2cbf-985b-47bc-b479-865c2a67a15f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=102950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:19:54.760209 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-057b2cbf-985b-47bc-b479-865c2a67a15f admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014080 May 13 17:19:54.760209 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 22/42] 10.222.0.64 () {60 vars in 1190 bytes} [Fri May 13 17:19:54 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 17:19:55.655518 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-cffce3e8-9156-4e99-9708-bc40bc2ef99a admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:55.656521 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-cffce3e8-9156-4e99-9708-bc40bc2ef99a admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001577 May 13 17:19:55.656917 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 21/43] 10.222.0.64 () {56 vars in 1074 bytes} [Fri May 13 17:19:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:19:55.842817 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-935011fb-efe8-4b03-91a2-310d0056b369 admin admin] Calling method '>' {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:55.848080 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.wsgi [None req-935011fb-efe8-4b03-91a2-310d0056b369 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 13 17:19:55.849561 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-935011fb-efe8-4b03-91a2-310d0056b369 admin admin] Request method failure captured: May 13 17:19:55.849561 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 13 17:19:55.849561 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: Accept: application/json May 13 17:19:55.849561 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: Accept-Encoding: gzip, deflate May 13 17:19:55.849561 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: Connection: keep-alive May 13 17:19:55.849561 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: Content-Length: 0 May 13 17:19:55.849561 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: Host: 10.222.0.64 May 13 17:19:55.849561 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: Openstack-Api-Version: compute 2.90 May 13 17:19:55.849561 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: Openstack-System-Scope: None May 13 17:19:55.849561 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: User-Agent: python-novaclient May 13 17:19:55.849561 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Auth-Token: gAAAAABifpM7_h3V0gPVBJe-MJ-LxoQ8Y3wFKHm34tIRggj60d1xznW4jt4thLjMf5IPBqZEE36gjF2ef26hBdTjMlCfSUvICtm5Qd7d7w0YfxLom8IOCORJIEEHfqDFaR_5LjYXf9fJisiAHwZVTecLIHZowEz1A9rmYrGW-jdRoufmkXN3NQA May 13 17:19:55.849561 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Domain-Id: None May 13 17:19:55.849561 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Domain-Name: None May 13 17:19:55.849561 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Identity-Status: Confirmed May 13 17:19:55.849561 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Is-Admin-Project: True May 13 17:19:55.849561 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Openstack-Nova-Api-Version: 2.90 May 13 17:19:55.849561 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Project-Domain-Id: default May 13 17:19:55.849561 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Project-Domain-Name: Default May 13 17:19:55.849561 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Project-Id: 6e1067556b2a41588af4e1e6fd0de9f1 May 13 17:19:55.849561 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Project-Name: admin May 13 17:19:55.849561 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Role: reader,admin,member May 13 17:19:55.849561 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Roles: reader,admin,member May 13 17:19:55.851054 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6e1067556b2a41588af4e1e6fd0de9f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6e1067556b2a41588af4e1e6fd0de9f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6e1067556b2a41588af4e1e6fd0de9f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6e1067556b2a41588af4e1e6fd0de9f1"}]}] May 13 17:19:55.851054 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Tenant: admin May 13 17:19:55.851054 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Tenant-Id: 6e1067556b2a41588af4e1e6fd0de9f1 May 13 17:19:55.851054 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Tenant-Name: admin May 13 17:19:55.851054 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-User: admin May 13 17:19:55.851054 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-User-Domain-Id: default May 13 17:19:55.851054 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-User-Domain-Name: Default May 13 17:19:55.851054 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-User-Id: 3163ceb80e1143e28503836c92928e92 May 13 17:19:55.851054 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-User-Name: admin May 13 17:19:55.851054 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: method: > May 13 17:19:55.851054 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: exception: Flavor 84 could not be found. May 13 17:19:55.851054 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: action_args: {'id': '84'} May 13 17:19:55.851054 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:19:55.851054 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:19:55.852085 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 17:19:55.852085 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 17:19:55.852085 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 17:19:55.852085 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 17:19:55.852085 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 17:19:55.852085 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 17:19:55.852085 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 17:19:55.852085 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 17:19:55.852085 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 17:19:55.852085 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:19:55.852085 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 17:19:55.852085 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 17:19:55.852085 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 13 17:19:55.852085 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi May 13 17:19:55.852085 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:19:55.852085 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi May 13 17:19:55.852085 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:19:55.852085 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:19:55.852085 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:19:55.853429 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:19:55.853429 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:19:55.853429 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:19:55.853429 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:19:55.853429 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 17:19:55.853429 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 17:19:55.853429 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 13 17:19:55.853429 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi May 13 17:19:55.853429 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:19:55.853429 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi May 13 17:19:55.853429 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:19:55.853429 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:19:55.853429 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:19:55.853429 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:19:55.853429 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:19:55.853429 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 13 17:19:55.853429 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi May 13 17:19:55.853429 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-935011fb-efe8-4b03-91a2-310d0056b369 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:19:55.854721 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-935011fb-efe8-4b03-91a2-310d0056b369 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059568 May 13 17:19:55.854721 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 23/44] 10.222.0.64 () {60 vars in 1190 bytes} [Fri May 13 17:19:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 17:19:55.860624 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-f9665507-1c80-4e1c-a381-04201242b908 admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:55.874471 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-f9665507-1c80-4e1c-a381-04201242b908 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017350 May 13 17:19:55.874938 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 22/45] 10.222.0.64 () {60 vars in 1210 bytes} [Fri May 13 17:19:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:19:55.883694 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-78bbce8c-6474-4ff7-8402-ff66e12e7f04 admin admin] Calling method '>' {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:55.897677 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-78bbce8c-6474-4ff7-8402-ff66e12e7f04 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017327 May 13 17:19:55.898192 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 24/46] 10.222.0.64 () {60 vars in 1210 bytes} [Fri May 13 17:19:55 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:19:55.907025 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-d42722dc-5c27-4d58-a176-3851a49544f3 admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:55.912091 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.wsgi [None req-d42722dc-5c27-4d58-a176-3851a49544f3 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 13 17:19:55.913576 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-d42722dc-5c27-4d58-a176-3851a49544f3 admin admin] Request method failure captured: May 13 17:19:55.913576 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 13 17:19:55.913576 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: Accept: application/json May 13 17:19:55.913576 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: Accept-Encoding: gzip, deflate May 13 17:19:55.913576 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: Connection: keep-alive May 13 17:19:55.913576 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: Content-Length: 0 May 13 17:19:55.913576 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: Host: 10.222.0.64 May 13 17:19:55.913576 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: Openstack-Api-Version: compute 2.90 May 13 17:19:55.913576 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: Openstack-System-Scope: None May 13 17:19:55.913576 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: User-Agent: python-novaclient May 13 17:19:55.913576 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Auth-Token: gAAAAABifpM7_h3V0gPVBJe-MJ-LxoQ8Y3wFKHm34tIRggj60d1xznW4jt4thLjMf5IPBqZEE36gjF2ef26hBdTjMlCfSUvICtm5Qd7d7w0YfxLom8IOCORJIEEHfqDFaR_5LjYXf9fJisiAHwZVTecLIHZowEz1A9rmYrGW-jdRoufmkXN3NQA May 13 17:19:55.913576 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Domain-Id: None May 13 17:19:55.913576 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Domain-Name: None May 13 17:19:55.913576 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Identity-Status: Confirmed May 13 17:19:55.913576 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Is-Admin-Project: True May 13 17:19:55.913576 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Openstack-Nova-Api-Version: 2.90 May 13 17:19:55.913576 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Project-Domain-Id: default May 13 17:19:55.913576 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Project-Domain-Name: Default May 13 17:19:55.913576 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Project-Id: 6e1067556b2a41588af4e1e6fd0de9f1 May 13 17:19:55.913576 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Project-Name: admin May 13 17:19:55.913576 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Role: reader,admin,member May 13 17:19:55.913576 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Roles: reader,admin,member May 13 17:19:55.915110 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6e1067556b2a41588af4e1e6fd0de9f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6e1067556b2a41588af4e1e6fd0de9f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6e1067556b2a41588af4e1e6fd0de9f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6e1067556b2a41588af4e1e6fd0de9f1"}]}] May 13 17:19:55.915110 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Tenant: admin May 13 17:19:55.915110 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Tenant-Id: 6e1067556b2a41588af4e1e6fd0de9f1 May 13 17:19:55.915110 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Tenant-Name: admin May 13 17:19:55.915110 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-User: admin May 13 17:19:55.915110 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-User-Domain-Id: default May 13 17:19:55.915110 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-User-Domain-Name: Default May 13 17:19:55.915110 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-User-Id: 3163ceb80e1143e28503836c92928e92 May 13 17:19:55.915110 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-User-Name: admin May 13 17:19:55.915110 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: method: > May 13 17:19:55.915110 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: exception: Flavor 84 could not be found. May 13 17:19:55.915110 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: action_args: {'id': '84'} May 13 17:19:55.915110 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:19:55.915110 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:19:55.916232 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 17:19:55.916232 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 17:19:55.916232 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 17:19:55.916232 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 17:19:55.916232 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 17:19:55.916232 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 17:19:55.916232 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 17:19:55.916232 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 17:19:55.916232 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 17:19:55.916232 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:19:55.916232 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 17:19:55.916232 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 17:19:55.916232 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 13 17:19:55.916232 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi May 13 17:19:55.916232 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:19:55.916232 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi May 13 17:19:55.916232 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:19:55.916232 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:19:55.916232 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:19:55.917302 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:19:55.917302 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:19:55.917302 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:19:55.917302 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:19:55.917302 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 17:19:55.917302 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 17:19:55.917302 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 13 17:19:55.917302 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi May 13 17:19:55.917302 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:19:55.917302 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi May 13 17:19:55.917302 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:19:55.917302 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:19:55.917302 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:19:55.917302 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:19:55.917302 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:19:55.917302 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 13 17:19:55.917302 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi May 13 17:19:55.917302 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-d42722dc-5c27-4d58-a176-3851a49544f3 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=102949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:19:55.918330 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-d42722dc-5c27-4d58-a176-3851a49544f3 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011313 May 13 17:19:55.918330 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 23/47] 10.222.0.64 () {60 vars in 1190 bytes} [Fri May 13 17:19:55 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 13 17:19:56.800460 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-78bbce8c-6474-4ff7-8402-ff66e12e7f04 admin admin] Calling method '>' {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:56.801466 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-78bbce8c-6474-4ff7-8402-ff66e12e7f04 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 May 13 17:19:56.801869 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 25/48] 10.222.0.64 () {56 vars in 1074 bytes} [Fri May 13 17:19:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:19:57.004926 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-a4e0012e-30f1-48ac-b526-a9f5b217e448 admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:57.011181 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.wsgi [None req-a4e0012e-30f1-48ac-b526-a9f5b217e448 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 13 17:19:57.012620 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-a4e0012e-30f1-48ac-b526-a9f5b217e448 admin admin] Request method failure captured: May 13 17:19:57.012620 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 13 17:19:57.012620 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: Accept: application/json May 13 17:19:57.012620 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: Accept-Encoding: gzip, deflate May 13 17:19:57.012620 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: Connection: keep-alive May 13 17:19:57.012620 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: Content-Length: 0 May 13 17:19:57.012620 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: Host: 10.222.0.64 May 13 17:19:57.012620 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: Openstack-Api-Version: compute 2.90 May 13 17:19:57.012620 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: Openstack-System-Scope: None May 13 17:19:57.012620 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: User-Agent: python-novaclient May 13 17:19:57.012620 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Auth-Token: gAAAAABifpM8k95b3toQcqujomyfwUnUfL8mKD4sGnTs_GXB7HYgUcMFM0R3cuxxT1_vreEIxrlOTLnCFiegyzUKV_NYrLl7kS5j-gJJb-IgKRZ8J0WGsQm3trI2xYncUU568D8DKFrLpt_XVf32a470a2uE8eDxpYzuJFrTHdpZMbHsYt9ZBFI May 13 17:19:57.012620 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Domain-Id: None May 13 17:19:57.012620 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Domain-Name: None May 13 17:19:57.012620 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Identity-Status: Confirmed May 13 17:19:57.012620 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Is-Admin-Project: True May 13 17:19:57.012620 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Openstack-Nova-Api-Version: 2.90 May 13 17:19:57.012620 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Project-Domain-Id: default May 13 17:19:57.012620 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Project-Domain-Name: Default May 13 17:19:57.012620 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Project-Id: 6e1067556b2a41588af4e1e6fd0de9f1 May 13 17:19:57.012620 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Project-Name: admin May 13 17:19:57.012620 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Role: reader,admin,member May 13 17:19:57.012620 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Roles: reader,admin,member May 13 17:19:57.014115 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6e1067556b2a41588af4e1e6fd0de9f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6e1067556b2a41588af4e1e6fd0de9f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6e1067556b2a41588af4e1e6fd0de9f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6e1067556b2a41588af4e1e6fd0de9f1"}]}] May 13 17:19:57.014115 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Tenant: admin May 13 17:19:57.014115 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Tenant-Id: 6e1067556b2a41588af4e1e6fd0de9f1 May 13 17:19:57.014115 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-Tenant-Name: admin May 13 17:19:57.014115 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-User: admin May 13 17:19:57.014115 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-User-Domain-Id: default May 13 17:19:57.014115 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-User-Domain-Name: Default May 13 17:19:57.014115 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-User-Id: 3163ceb80e1143e28503836c92928e92 May 13 17:19:57.014115 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: X-User-Name: admin May 13 17:19:57.014115 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: method: > May 13 17:19:57.014115 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: exception: Flavor 451 could not be found. May 13 17:19:57.014115 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: action_args: {'id': '451'} May 13 17:19:57.014115 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:19:57.014115 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:19:57.014986 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 17:19:57.014986 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 17:19:57.014986 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 17:19:57.014986 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 17:19:57.014986 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 17:19:57.014986 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 17:19:57.014986 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 17:19:57.014986 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 17:19:57.014986 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 17:19:57.014986 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:19:57.014986 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 17:19:57.014986 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 17:19:57.014986 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 13 17:19:57.014986 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi May 13 17:19:57.014986 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:19:57.014986 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi May 13 17:19:57.014986 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:19:57.014986 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:19:57.014986 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:19:57.016142 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:19:57.016142 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:19:57.016142 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:19:57.016142 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:19:57.016142 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 17:19:57.016142 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 17:19:57.016142 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 13 17:19:57.016142 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi May 13 17:19:57.016142 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:19:57.016142 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi May 13 17:19:57.016142 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:19:57.016142 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:19:57.016142 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:19:57.016142 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:19:57.016142 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:19:57.016142 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 13 17:19:57.016142 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: ERROR nova.api.openstack.wsgi May 13 17:19:57.016142 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-a4e0012e-30f1-48ac-b526-a9f5b217e448 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102949) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:19:57.017167 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-a4e0012e-30f1-48ac-b526-a9f5b217e448 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.062172 May 13 17:19:57.017167 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 24/49] 10.222.0.64 () {60 vars in 1193 bytes} [Fri May 13 17:19:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 17:19:57.023576 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-830dd0b2-c1ad-4f4b-a9ee-ab1791c032e0 admin admin] Calling method '>' {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:57.037514 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-830dd0b2-c1ad-4f4b-a9ee-ab1791c032e0 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017434 May 13 17:19:57.038055 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 26/50] 10.222.0.64 () {60 vars in 1210 bytes} [Fri May 13 17:19:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:19:57.047038 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-338caf53-a046-4f7d-a96f-e196a471014f admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:57.060311 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-338caf53-a046-4f7d-a96f-e196a471014f admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016657 May 13 17:19:57.060857 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 25/51] 10.222.0.64 () {60 vars in 1210 bytes} [Fri May 13 17:19:57 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:19:57.069360 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-0dc941b4-363b-44a5-831a-2a401c7933c4 admin admin] Calling method '>' {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:57.074866 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.wsgi [None req-0dc941b4-363b-44a5-831a-2a401c7933c4 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 13 17:19:57.076371 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-0dc941b4-363b-44a5-831a-2a401c7933c4 admin admin] Request method failure captured: May 13 17:19:57.076371 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 13 17:19:57.076371 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: Accept: application/json May 13 17:19:57.076371 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: Accept-Encoding: gzip, deflate May 13 17:19:57.076371 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: Connection: keep-alive May 13 17:19:57.076371 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: Content-Length: 0 May 13 17:19:57.076371 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: Host: 10.222.0.64 May 13 17:19:57.076371 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: Openstack-Api-Version: compute 2.90 May 13 17:19:57.076371 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: Openstack-System-Scope: None May 13 17:19:57.076371 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: User-Agent: python-novaclient May 13 17:19:57.076371 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Auth-Token: gAAAAABifpM8k95b3toQcqujomyfwUnUfL8mKD4sGnTs_GXB7HYgUcMFM0R3cuxxT1_vreEIxrlOTLnCFiegyzUKV_NYrLl7kS5j-gJJb-IgKRZ8J0WGsQm3trI2xYncUU568D8DKFrLpt_XVf32a470a2uE8eDxpYzuJFrTHdpZMbHsYt9ZBFI May 13 17:19:57.076371 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Domain-Id: None May 13 17:19:57.076371 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Domain-Name: None May 13 17:19:57.076371 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Identity-Status: Confirmed May 13 17:19:57.076371 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Is-Admin-Project: True May 13 17:19:57.076371 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Openstack-Nova-Api-Version: 2.90 May 13 17:19:57.076371 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Project-Domain-Id: default May 13 17:19:57.076371 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Project-Domain-Name: Default May 13 17:19:57.076371 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Project-Id: 6e1067556b2a41588af4e1e6fd0de9f1 May 13 17:19:57.076371 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Project-Name: admin May 13 17:19:57.076371 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Role: reader,admin,member May 13 17:19:57.076371 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Roles: reader,admin,member May 13 17:19:57.077888 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6e1067556b2a41588af4e1e6fd0de9f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6e1067556b2a41588af4e1e6fd0de9f1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6e1067556b2a41588af4e1e6fd0de9f1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6e1067556b2a41588af4e1e6fd0de9f1"}]}] May 13 17:19:57.077888 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Tenant: admin May 13 17:19:57.077888 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Tenant-Id: 6e1067556b2a41588af4e1e6fd0de9f1 May 13 17:19:57.077888 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-Tenant-Name: admin May 13 17:19:57.077888 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-User: admin May 13 17:19:57.077888 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-User-Domain-Id: default May 13 17:19:57.077888 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-User-Domain-Name: Default May 13 17:19:57.077888 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-User-Id: 3163ceb80e1143e28503836c92928e92 May 13 17:19:57.077888 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: X-User-Name: admin May 13 17:19:57.077888 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: method: > May 13 17:19:57.077888 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: exception: Flavor 451 could not be found. May 13 17:19:57.077888 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: action_args: {'id': '451'} May 13 17:19:57.077888 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:19:57.077888 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:19:57.078742 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 13 17:19:57.078742 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 13 17:19:57.078742 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 13 17:19:57.078742 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 13 17:19:57.078742 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 17:19:57.078742 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 17:19:57.078742 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 13 17:19:57.078742 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 13 17:19:57.078742 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 13 17:19:57.078742 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:19:57.078742 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 13 17:19:57.078742 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 13 17:19:57.078742 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 13 17:19:57.078742 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi May 13 17:19:57.078742 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:19:57.078742 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi May 13 17:19:57.078742 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:19:57.078742 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:19:57.078742 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:19:57.079889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:19:57.079889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:19:57.079889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:19:57.079889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:19:57.079889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 13 17:19:57.079889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 13 17:19:57.079889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 13 17:19:57.079889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi May 13 17:19:57.079889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:19:57.079889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi May 13 17:19:57.079889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:19:57.079889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:19:57.079889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:19:57.079889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:19:57.079889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:19:57.079889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 13 17:19:57.079889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: ERROR nova.api.openstack.wsgi May 13 17:19:57.079889 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-0dc941b4-363b-44a5-831a-2a401c7933c4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=102950) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:19:57.080931 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-0dc941b4-363b-44a5-831a-2a401c7933c4 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011719 May 13 17:19:57.080931 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 27/52] 10.222.0.64 () {60 vars in 1193 bytes} [Fri May 13 17:19:57 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 13 17:19:57.969226 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-338caf53-a046-4f7d-a96f-e196a471014f admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:57.970243 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-338caf53-a046-4f7d-a96f-e196a471014f admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 May 13 17:19:57.970913 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 26/53] 10.222.0.64 () {56 vars in 1074 bytes} [Fri May 13 17:19:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:19:58.158960 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-d80a17c1-ff31-4869-b998-b6f1477af7d3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:19:58.276650 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-d80a17c1-ff31-4869-b998-b6f1477af7d3 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.167761 May 13 17:19:58.277112 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 28/54] 10.222.0.64 () {64 vars in 1235 bytes} [Fri May 13 17:19:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 17:19:59.170971 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-338caf53-a046-4f7d-a96f-e196a471014f admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:19:59.172040 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-338caf53-a046-4f7d-a96f-e196a471014f admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 May 13 17:19:59.172430 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 27/55] 10.222.0.64 () {56 vars in 1074 bytes} [Fri May 13 17:19:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:19:59.358837 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-e1c81f22-2a2c-4f85-96bb-6b537b4e2a60 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:19:59.475864 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-e1c81f22-2a2c-4f85-96bb-6b537b4e2a60 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.166805 May 13 17:19:59.476404 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 29/56] 10.222.0.64 () {64 vars in 1235 bytes} [Fri May 13 17:19:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 17:20:00.360265 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-338caf53-a046-4f7d-a96f-e196a471014f admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:20:00.361275 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-338caf53-a046-4f7d-a96f-e196a471014f admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 May 13 17:20:00.361674 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 28/57] 10.222.0.64 () {56 vars in 1074 bytes} [Fri May 13 17:20:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:20:00.554344 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-67c165ad-e5b0-4ff0-9393-a6520bc55ba8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:20:00.629916 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-67c165ad-e5b0-4ff0-9393-a6520bc55ba8 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.128606 May 13 17:20:00.634085 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 30/58] 10.222.0.64 () {64 vars in 1235 bytes} [Fri May 13 17:20:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 17:20:01.520579 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-338caf53-a046-4f7d-a96f-e196a471014f admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:20:01.521586 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-338caf53-a046-4f7d-a96f-e196a471014f admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 May 13 17:20:01.525139 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 29/59] 10.222.0.64 () {56 vars in 1074 bytes} [Fri May 13 17:20:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:20:01.720187 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-fb8466ff-fb66-4bc3-bcbc-14a6dc6cafd7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:20:01.796290 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-fb8466ff-fb66-4bc3-bcbc-14a6dc6cafd7 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.126901 May 13 17:20:01.796839 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 31/60] 10.222.0.64 () {64 vars in 1235 bytes} [Fri May 13 17:20:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 17:20:02.679623 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-338caf53-a046-4f7d-a96f-e196a471014f admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:20:02.680661 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-338caf53-a046-4f7d-a96f-e196a471014f admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 May 13 17:20:02.681069 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 30/61] 10.222.0.64 () {56 vars in 1074 bytes} [Fri May 13 17:20:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:20:02.866247 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-a03d4d99-a528-4b58-9695-5b90a65f4224 admin admin] Calling method '>' {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:20:02.885066 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-a03d4d99-a528-4b58-9695-5b90a65f4224 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.068963 May 13 17:20:02.885594 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 32/62] 10.222.0.64 () {60 vars in 1202 bytes} [Fri May 13 17:20:02 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:21:05.247348 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-338caf53-a046-4f7d-a96f-e196a471014f admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:21:05.248293 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-338caf53-a046-4f7d-a96f-e196a471014f admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 May 13 17:21:05.248691 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 31/63] 10.222.0.64 () {54 vars in 930 bytes} [Fri May 13 17:21:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:21:05.309190 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-3e8b9d59-d108-42c9-bc6e-5a43d34ab541 admin admin] Calling method '>' {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:21:05.329341 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-3e8b9d59-d108-42c9-bc6e-5a43d34ab541 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074909 May 13 17:21:05.329890 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 33/64] 10.222.0.64 () {60 vars in 1291 bytes} [Fri May 13 17:21:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:21:05.352761 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-3f36fb7c-a4b8-4f79-8492-7f5dc2dc9ed5 admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:21:05.360833 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-3f36fb7c-a4b8-4f79-8492-7f5dc2dc9ed5 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012266 May 13 17:21:05.361346 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 32/65] 10.222.0.64 () {60 vars in 1282 bytes} [Fri May 13 17:21:05 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:21:05.372636 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-b589859e-1048-4d65-a7ba-a4068639df2b admin admin] Calling method '>' {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:21:05.380002 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-b589859e-1048-4d65-a7ba-a4068639df2b admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011437 May 13 17:21:05.380508 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 34/66] 10.222.0.64 () {60 vars in 1285 bytes} [Fri May 13 17:21:05 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:21:05.391003 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-fa70e1e4-c59f-470f-a719-3dea52e04e77 admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:21:05.398144 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-fa70e1e4-c59f-470f-a719-3dea52e04e77 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010471 May 13 17:21:05.398655 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 33/67] 10.222.0.64 () {60 vars in 1285 bytes} [Fri May 13 17:21:05 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:21:05.409195 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-5aff48c7-3f4e-4e13-ab9e-605f4c9d0199 admin admin] Calling method '>' {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:21:05.417263 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-5aff48c7-3f4e-4e13-ab9e-605f4c9d0199 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011439 May 13 17:21:05.417789 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 35/68] 10.222.0.64 () {60 vars in 1282 bytes} [Fri May 13 17:21:05 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:24:36.863744 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-fa70e1e4-c59f-470f-a719-3dea52e04e77 admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:24:36.864795 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-fa70e1e4-c59f-470f-a719-3dea52e04e77 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 May 13 17:24:36.865195 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 34/69] 10.222.0.64 () {56 vars in 1074 bytes} [Fri May 13 17:24:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:24:37.128361 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-e60cfed9-d9bf-4c10-98b3-f67019fc55cb admin admin] Calling method '>' {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:24:37.129522 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 17:24:37.129522 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: warnings.warn(msg) May 13 17:24:37.130701 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG oslo_concurrency.lockutils [None req-e60cfed9-d9bf-4c10-98b3-f67019fc55cb admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:24:37.131143 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG oslo_concurrency.lockutils [None req-e60cfed9-d9bf-4c10-98b3-f67019fc55cb admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:24:37.131926 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG oslo_concurrency.lockutils [None req-e60cfed9-d9bf-4c10-98b3-f67019fc55cb admin admin] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:24:37.132348 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG oslo_concurrency.lockutils [None req-e60cfed9-d9bf-4c10-98b3-f67019fc55cb admin admin] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:24:37.165608 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-e60cfed9-d9bf-4c10-98b3-f67019fc55cb admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.147846 May 13 17:24:37.166150 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 36/70] 10.222.0.64 () {60 vars in 1193 bytes} [Fri May 13 17:24:37 2022] GET /compute/v2.1/os-services => generated 791 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 17:24:38.061171 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-fa70e1e4-c59f-470f-a719-3dea52e04e77 admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:24:38.062179 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-fa70e1e4-c59f-470f-a719-3dea52e04e77 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 13 17:24:38.062577 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 35/71] 10.222.0.64 () {56 vars in 1074 bytes} [Fri May 13 17:24:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:24:38.253699 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-6c69bac1-6bb3-4454-bd48-6c363522a2c3 admin admin] Calling method '>' {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:24:38.254864 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 17:24:38.254864 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: warnings.warn(msg) May 13 17:24:38.256053 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG oslo_concurrency.lockutils [None req-6c69bac1-6bb3-4454-bd48-6c363522a2c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:24:38.256512 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG oslo_concurrency.lockutils [None req-6c69bac1-6bb3-4454-bd48-6c363522a2c3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:24:38.257296 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG oslo_concurrency.lockutils [None req-6c69bac1-6bb3-4454-bd48-6c363522a2c3 admin admin] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:24:38.257742 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG oslo_concurrency.lockutils [None req-6c69bac1-6bb3-4454-bd48-6c363522a2c3 admin admin] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:24:38.277541 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-6c69bac1-6bb3-4454-bd48-6c363522a2c3 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.078516 May 13 17:24:38.278101 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 37/72] 10.222.0.64 () {60 vars in 1193 bytes} [Fri May 13 17:24:38 2022] GET /compute/v2.1/os-services => generated 791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 17:24:49.604665 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-fa70e1e4-c59f-470f-a719-3dea52e04e77 admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:24:49.605742 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-fa70e1e4-c59f-470f-a719-3dea52e04e77 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001442 May 13 17:24:49.606139 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 36/73] 10.222.0.64 () {56 vars in 1074 bytes} [Fri May 13 17:24:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:24:49.794479 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-c1c95ff4-6fd3-49ef-8812-082d63fac937 admin admin] Calling method '>' {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:24:49.795686 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 17:24:49.795686 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: warnings.warn(msg) May 13 17:24:49.796854 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG oslo_concurrency.lockutils [None req-c1c95ff4-6fd3-49ef-8812-082d63fac937 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:24:49.797289 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG oslo_concurrency.lockutils [None req-c1c95ff4-6fd3-49ef-8812-082d63fac937 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:24:49.798094 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG oslo_concurrency.lockutils [None req-c1c95ff4-6fd3-49ef-8812-082d63fac937 admin admin] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:24:49.798515 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG oslo_concurrency.lockutils [None req-c1c95ff4-6fd3-49ef-8812-082d63fac937 admin admin] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:24:49.821987 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-c1c95ff4-6fd3-49ef-8812-082d63fac937 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.078701 May 13 17:24:49.822521 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 38/74] 10.222.0.64 () {60 vars in 1193 bytes} [Fri May 13 17:24:49 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:24:50.728469 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: DEBUG nova.api.openstack.wsgi [None req-fa70e1e4-c59f-470f-a719-3dea52e04e77 admin admin] Calling method '>' {{(pid=102949) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:24:50.729475 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: INFO nova.api.openstack.requestlog [None req-fa70e1e4-c59f-470f-a719-3dea52e04e77 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 May 13 17:24:50.729875 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: [pid: 102949|app: 0|req: 37/75] 10.222.0.64 () {56 vars in 1074 bytes} [Fri May 13 17:24:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:24:50.923793 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG nova.api.openstack.wsgi [None req-f2915c3f-a6b6-4b49-81ea-4626c6f58de2 admin admin] Calling method '>' {{(pid=102950) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:24:50.924963 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 13 17:24:50.924963 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: warnings.warn(msg) May 13 17:24:50.926120 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG oslo_concurrency.lockutils [None req-f2915c3f-a6b6-4b49-81ea-4626c6f58de2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:24:50.926554 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG oslo_concurrency.lockutils [None req-f2915c3f-a6b6-4b49-81ea-4626c6f58de2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:24:50.927367 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG oslo_concurrency.lockutils [None req-f2915c3f-a6b6-4b49-81ea-4626c6f58de2 admin admin] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=102950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:24:50.928492 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: DEBUG oslo_concurrency.lockutils [None req-f2915c3f-a6b6-4b49-81ea-4626c6f58de2 admin admin] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=102950) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:24:50.950017 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: INFO nova.api.openstack.requestlog [None req-f2915c3f-a6b6-4b49-81ea-4626c6f58de2 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.081531 May 13 17:24:50.950492 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: [pid: 102950|app: 0|req: 39/76] 10.222.0.64 () {60 vars in 1193 bytes} [Fri May 13 17:24:50 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:25:49.921313 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: Fri May 13 17:25:49 2022 - graceful shutdown triggered... May 13 17:25:49.921830 dv-cinder-841782-1-iscsi devstack@n-api.service[102949]: Gracefully killing worker 1 (pid: 102949)... May 13 17:25:49.921865 dv-cinder-841782-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 13 17:25:49.922571 dv-cinder-841782-1-iscsi devstack@n-api.service[102950]: Gracefully killing worker 2 (pid: 102950)... May 13 17:25:50.922075 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: worker 1 buried after 1 seconds May 13 17:25:50.922075 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: worker 2 buried after 1 seconds May 13 17:25:50.922075 dv-cinder-841782-1-iscsi devstack@n-api.service[102948]: goodbye to uWSGI. May 13 17:25:50.923638 dv-cinder-841782-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 13 17:25:50.924214 dv-cinder-841782-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 13 17:25:50.926910 dv-cinder-841782-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 13 17:25:50.941551 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 13 17:25:50.960653 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri May 13 17:25:50 2022] *** May 13 17:25:50.960653 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 13 17:25:50.960653 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 13 17:25:50.960653 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: nodename: dv-cinder-841782-1-iscsi May 13 17:25:50.960653 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: machine: x86_64 May 13 17:25:50.960653 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: clock source: unix May 13 17:25:50.960653 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: pcre jit disabled May 13 17:25:50.960653 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: detected number of CPU cores: 4 May 13 17:25:50.960653 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: current working directory: / May 13 17:25:50.960653 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: detected binary path: /usr/bin/uwsgi-core May 13 17:25:50.960653 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: your processes number limit is 47680 May 13 17:25:50.960653 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: your memory page size is 4096 bytes May 13 17:25:50.961600 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: detected max file descriptor number: 2048 May 13 17:25:50.961600 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: lock engine: pthread robust mutexes May 13 17:25:50.961600 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: thunder lock: enabled May 13 17:25:50.961600 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 13 17:25:50.961600 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 13 17:25:51.008382 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: Python main interpreter initialized at 0x5561c41179c0 May 13 17:25:51.008382 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: python threads support enabled May 13 17:25:51.008382 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: your server socket listen backlog is limited to 100 connections May 13 17:25:51.008668 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: your mercy for graceful operations on workers is 90 seconds May 13 17:25:51.008757 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: mapped 403077 bytes (393 KB) for 2 cores May 13 17:25:51.008849 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: *** Operational MODE: preforking *** May 13 17:25:51.009106 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: *** uWSGI is running in multiple interpreter mode *** May 13 17:25:51.009106 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: spawned uWSGI master process (pid: 117477) May 13 17:25:51.009309 dv-cinder-841782-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 13 17:25:51.020035 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: spawned uWSGI worker 1 (pid: 117492, cores: 1) May 13 17:25:51.020035 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: spawned uWSGI worker 2 (pid: 117493, cores: 1) May 13 17:25:51.020035 dv-cinder-841782-1-iscsi devstack@n-api.service[117477]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 13 17:25:52.230342 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 17:25:52.232273 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 13 17:25:53.034411 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 17:25:53.034411 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: from cryptography.utils import int_from_bytes May 13 17:25:53.037153 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 17:25:53.037153 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: from cryptography.utils import int_from_bytes May 13 17:25:53.037313 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 17:25:53.037313 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: from cryptography.utils import int_from_bytes May 13 17:25:53.037442 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 13 17:25:53.037442 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: from cryptography.utils import int_from_bytes May 13 17:25:55.523852 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 17:25:55.523852 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 17:25:55.523852 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 17:25:55.523852 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 17:25:55.523852 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 17:25:55.523852 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.523852 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.523852 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.524941 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.524941 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.524941 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.524941 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.524941 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.524941 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.524941 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.524941 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.525487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841782-1-iscsi {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.525487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.525487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.525698 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.526187 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.526307 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.526565 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.526881 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.527636 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.528387 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.528710 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.529276 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.529626 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.530531 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.530864 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.531208 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.531531 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.531874 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.532201 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.532617 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841782-1-iscsi {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.533021 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.533346 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.533670 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.534096 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.534418 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.534753 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.535080 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.535430 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.535783 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.536149 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.536480 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.536811 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.537143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.537452 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.537771 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.538090 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.538419 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.538741 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.539051 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.539338 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.539661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.540374 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.540374 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.540775 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.540974 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.541207 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.541530 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.541860 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.542180 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.542498 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.542814 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.543169 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.543472 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.543786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.544099 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.544413 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.544742 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.545065 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.545397 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.545747 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.546077 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.546491 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.546750 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.547069 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.547448 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.547849 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.548092 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.548420 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.548752 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.549087 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.549394 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.549707 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.550033 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.550373 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.550680 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.550938 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.551275 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.551595 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.552623 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.552623 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.552623 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.553059 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.553209 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.553434 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.553817 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.554135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.554452 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.554769 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.555086 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.555430 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.555764 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.556103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.556435 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.556766 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.557086 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.557401 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.557692 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 13 17:25:55.558194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.558353 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 13 17:25:55.558508 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.558508 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.558789 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 13 17:25:55.558933 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.559175 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 13 17:25:55.559347 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.559514 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 13 17:25:55.559666 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.559838 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.559991 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.560143 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.560320 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.560476 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.560628 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.560780 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.560931 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.561085 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.562208 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.562405 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.562556 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.562712 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.562857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.563017 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.563210 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.563501 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.563682 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.563852 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.564531 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.564702 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.564859 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.565011 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-841782-1-iscsi {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.565156 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.565306 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.565461 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.565613 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.565768 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.567025 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.567789 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.567954 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.568108 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.568265 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.568428 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.568582 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.568737 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.568893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.569062 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.569062 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.569564 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.571931 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.572532 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.572698 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.572857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.573012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.573175 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.573331 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.573512 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.573669 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.573823 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.573974 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.574130 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.574288 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.574455 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.574832 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.574999 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.575192 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.575347 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.575347 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.575633 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.575633 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.575933 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-841782-1-iscsi {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.576085 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.576255 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.576255 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.576565 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.576718 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.576945 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.576945 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.577740 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.577886 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.578039 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.578196 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.578342 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.578494 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.578646 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.578790 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.580059 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.580059 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.580254 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.580339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.580413 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.580491 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.580563 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.580649 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.580736 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.580819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.580891 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.580962 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.581031 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.581122 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.581214 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.581310 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.581401 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.581511 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.581617 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.581711 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.581805 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.581891 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.581982 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.582074 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.582169 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.582255 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.582339 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.582422 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.582514 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.582606 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.582701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.582787 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.582787 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.582941 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.583025 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.583119 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.583258 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.583346 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.587198 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.592160 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.592372 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.592579 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.592757 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.592907 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.592907 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.593197 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.593370 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.593523 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.593728 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.593892 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.594037 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.594192 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.594338 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.594490 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.594643 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.594817 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.594963 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.595163 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.595330 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.595484 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.598128 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.598307 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.598485 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.598653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.598810 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.598966 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.599113 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.599383 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.599531 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.599715 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.599881 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.600036 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.600180 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.600335 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.600617 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.600789 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.600946 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.601093 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.601244 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.601409 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.601572 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.602342 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.602509 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.602663 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.602809 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.602961 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.603115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.603319 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.603465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.603609 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.603752 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.603903 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.604058 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.604216 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.604362 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.604514 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.604659 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.604811 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.604963 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.605115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.605285 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.605431 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.605575 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.605732 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.605885 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.606031 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.606031 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.606327 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.606483 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.606635 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.606786 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.606936 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.607080 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.607275 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.607432 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.607577 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.607734 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.607885 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.608058 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.608212 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.608365 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.608510 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.608802 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.608961 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.609126 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.609277 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.609440 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.609586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.609744 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.609891 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.610042 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.610187 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.610331 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.610483 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.610636 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.610781 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.610932 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.611086 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.611291 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.611447 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.611601 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.611772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.612590 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.612756 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.612912 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.613065 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.613211 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.613362 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.613523 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.613671 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.613823 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.613985 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.614139 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.614283 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.614436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.614581 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.614733 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.614884 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.615036 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.615036 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.615368 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.615514 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.615665 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.615810 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.615965 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.616122 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.616267 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.616411 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.616562 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.616714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.616870 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.617029 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.617184 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.617336 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.617488 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.617677 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.617841 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.618015 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.618161 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.618454 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.618626 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.618813 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.618968 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.619139 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.619307 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.619472 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.619626 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.619771 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.619928 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.620074 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.620227 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.620379 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.620534 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.620681 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 13 17:25:55.620834 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.620987 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.621140 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.621285 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.621435 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.621594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.621759 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.621918 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.622717 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.622882 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.623044 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.623230 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.623403 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.623556 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.624281 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.624450 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.624603 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.624764 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.624928 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.625086 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.625247 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.625416 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.625568 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.625732 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.625898 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.626058 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.626211 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.626432 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.626601 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.626769 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.626928 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.627081 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.627307 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.627469 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.628208 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.628398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.628677 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.628840 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.629001 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.629159 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.629320 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.629481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.629634 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.629785 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.629942 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.630101 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.630506 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.630678 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.630839 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.630991 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.631172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.631330 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.631495 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.631655 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.631806 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.631957 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.632115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.632892 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.633071 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.633245 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.633404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.633557 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.633708 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.633873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.634033 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.634185 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.634336 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.634494 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.634654 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.634817 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.635583 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.635746 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.635913 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.636072 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.636225 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.636385 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.636537 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.636932 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.637104 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.637272 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.637425 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.637583 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.637735 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.637909 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.638070 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.638222 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.638496 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.638776 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.638932 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.639099 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.639859 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.640028 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.640189 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.640348 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.640500 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.640661 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.640832 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.640987 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.641138 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.641297 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.641458 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.641618 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.641789 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.641952 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.642103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.642559 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.643095 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.643327 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.643490 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.643660 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.643820 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.643980 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.644148 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.644309 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.644469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.644622 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.644772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.644923 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.645083 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.645243 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.645437 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.645641 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.645797 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.645959 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.646111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.646263 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.646413 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.646573 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.646724 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.646883 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.647044 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.647241 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.647403 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.647555 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.647555 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.647867 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.648027 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.648178 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.648351 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.648790 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.648890 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.648993 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.649089 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.649183 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.649279 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.649363 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.649458 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.649551 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.649643 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.649727 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.649805 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.649876 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.649956 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.650049 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.650135 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.650218 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.650301 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.650390 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.650484 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.650577 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.650951 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.651053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.651206 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.651287 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.651373 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.651463 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.651536 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.651607 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.651684 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.651769 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.651848 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.651919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.652003 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.652085 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.652175 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.652175 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.652354 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.652572 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.652832 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.653124 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.653223 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.653318 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.653404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.653489 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.653580 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.653666 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.653756 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.653849 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.653935 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.654026 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.654120 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.654212 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.654306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.654398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.654494 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.654587 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.654682 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.654767 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.654873 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.654961 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.655044 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.655322 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.655437 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.655526 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.655610 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.655693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.655776 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.655869 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.655962 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.656055 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.656140 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.656231 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.656315 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.656407 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.656492 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.656582 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.656675 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.656760 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.656843 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.657004 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.657091 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.657174 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.657264 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.657356 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.657440 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.657533 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.657625 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.657710 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.657792 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.657882 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.657967 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.657967 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.658133 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.658228 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.658320 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.658411 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.658506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.658591 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.658681 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.658681 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.658873 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.658958 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.659055 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.659179 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.659278 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.659370 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.659463 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.659555 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.659653 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.659747 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.659838 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.659922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.660011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.660096 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.660187 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.660187 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.660350 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.660440 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.660524 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.660524 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.660691 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.660691 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.660844 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.660933 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.661017 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.661113 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.661891 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.662003 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.662091 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.662176 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.662259 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.662357 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.662443 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.662542 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.662628 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.662927 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.663045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.663268 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.663359 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.663446 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.663530 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.663612 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.663705 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.663799 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.663883 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.663967 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.664050 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.664050 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.664050 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.664050 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.664354 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.664451 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.664581 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.664687 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.664788 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.664875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.664965 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.665055 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.665140 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.665223 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.665319 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.665421 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.665494 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.665564 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.665654 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.665749 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.665834 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.665917 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.666000 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.666083 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.666183 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.666281 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.666374 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.666459 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.666542 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.666632 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.666716 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.666809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.666894 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.666978 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.667068 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.667231 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.667335 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.667422 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.667520 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.667606 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.667698 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.667790 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.667890 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.667984 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.668070 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.668165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.668251 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.668334 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.668426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.668518 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.668603 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.668686 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.668768 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.668859 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.668953 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.669045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.669129 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.669220 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.669313 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.669407 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.669500 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.669585 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.669668 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.669759 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.669850 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.669953 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.670046 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.670139 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.670231 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.670316 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.670399 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.670521 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.670616 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.670709 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.670794 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.670878 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.670961 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.671054 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.671192 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.671299 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.671393 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.671478 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.671575 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.671669 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.671755 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.671845 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.671930 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.672013 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.672148 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.672244 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.672244 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.672407 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.672498 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.672590 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.672694 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.672780 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.673077 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.673185 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.673295 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.673378 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.673471 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.673546 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.673546 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.673707 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.673806 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.673892 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.673984 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.674078 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.674168 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.674252 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.674342 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.674441 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.674538 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.674631 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.674717 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.674808 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.674893 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.674989 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.675082 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.675182 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.675280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.675380 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.675473 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.675558 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.675630 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.675707 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.675870 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.675958 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.676050 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.676145 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.676230 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.676314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.676411 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.676497 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.676580 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.676665 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.676756 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.676850 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.676944 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.677030 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.677113 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.677204 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.677288 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.677380 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.677473 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.677558 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.677641 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.677724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.677814 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.677912 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.677998 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.678088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.678167 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.678246 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.678318 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.678402 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.678488 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.678562 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.678640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.678720 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.678800 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.678885 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.678958 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.679028 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.679098 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.679224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.679298 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.679386 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.679467 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.679552 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.679635 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.679708 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.679858 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.679933 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.680003 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.680073 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.680150 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.680221 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.680305 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.680377 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.680446 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.680516 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.680593 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.680672 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.680761 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.680840 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.680911 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.680988 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.681060 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.681060 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.681060 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.681060 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.681324 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.681396 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.681466 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.681548 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.681627 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.681699 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.681769 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.681837 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.681914 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.681995 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.682067 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.682150 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.682230 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.682302 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.682380 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.682464 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.682545 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.682617 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.682693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.682771 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.682850 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.682930 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.683244 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.683531 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.683697 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.684014 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.684327 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.684525 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.684644 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.685351 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.685477 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.685574 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.685676 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.685758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.685838 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.685923 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.686013 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.686713 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.686825 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.687034 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.687171 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.687431 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.687515 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.687814 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.687929 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.688138 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.688239 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.688565 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.688679 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.688778 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.688865 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.689068 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.689159 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.689409 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.689505 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.689722 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.689815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.690036 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.690131 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.690353 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.690455 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.690686 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.690805 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.691014 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.691172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.691356 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.691506 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.691674 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.691847 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.691986 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.692189 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.692285 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.692511 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.692613 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.692830 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.692931 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.693284 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.693403 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.693502 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.693596 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.693776 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.693920 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.694082 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.694189 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.694393 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.694509 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.694721 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.694827 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.695036 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.695176 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.695375 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.695496 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.695687 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.695799 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.695998 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.696111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.696329 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.696440 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.696643 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.696746 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.696973 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.697085 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.697297 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.697401 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.697615 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.697719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.697938 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.698051 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.698253 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.698359 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.698566 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.698658 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.698887 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.699005 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.699222 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.699326 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.699536 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.699641 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.699850 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.699945 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.700170 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.700266 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.700481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.700575 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.700798 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.700894 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.701126 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.701222 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.701444 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.701548 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.701812 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.702411 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.702649 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.702745 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.702982 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.703081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.703386 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.703812 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.703906 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.703993 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.704088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.704185 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.704260 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.704413 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.704560 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.704755 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.704930 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.705098 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.705262 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.705425 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.705607 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.705765 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.705931 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.706115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.706279 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.706457 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.707037 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.707251 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.707428 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.707591 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.707753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.707916 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.708070 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.708233 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.708386 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.708546 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.708717 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.708878 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.709030 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.709197 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.709350 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.709508 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.709661 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.709812 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.709978 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.710132 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.710283 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.710435 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.710586 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.710747 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.710913 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.711073 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.711073 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.711409 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.711562 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.711721 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.711887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.712040 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.712199 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.712353 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.712510 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.712664 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.712664 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.712976 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.713127 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.713285 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.713438 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.713589 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.713954 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.714116 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.714116 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.714455 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.714616 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.714778 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.714938 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.715101 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.715277 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.715442 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.715601 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.715768 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.715927 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.716080 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.716231 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.716640 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.716640 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.716950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.717104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.717273 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.717463 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.717616 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.717816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.717987 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.718147 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.718306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.718459 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.718619 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.718780 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.718940 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.719092 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.719403 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.719570 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.719721 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.719882 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.720042 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.720194 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.720354 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.720506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.720657 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.720818 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.720978 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.721138 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.721290 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.721459 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.721625 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.721786 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.721945 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.722105 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.722264 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.722417 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.722577 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.722737 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.722889 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.723048 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.723222 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.723403 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.723556 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.723716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.724067 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.724235 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.724388 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.724551 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.724704 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.724857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.725009 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.725168 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.725322 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.725490 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.725662 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.725824 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.725977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.726136 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.726288 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.726449 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.726602 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.726778 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.726934 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.727093 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.727341 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.727504 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.727667 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.727818 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.727978 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.728131 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.728296 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.728456 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.728633 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.728799 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.728960 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.729121 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.729283 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.729436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.729587 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.729756 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.729756 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.730062 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.730215 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.730493 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.730667 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.730829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.730981 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.731241 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.731403 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.731555 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.731706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.731876 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.732029 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.732190 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.732343 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.732494 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.732659 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.732811 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.733007 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.733228 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.733387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.733548 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.733708 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.733862 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.734238 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.734401 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.734562 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.734714 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.734874 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.735016 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.735206 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.735301 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.735398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.735485 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.735577 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.735671 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.735767 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.735860 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.735949 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.735949 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.736101 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.736193 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.736287 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.736373 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.736459 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.736533 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.736624 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.736718 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.736804 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.736889 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.736973 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.737063 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.737156 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.737156 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.737337 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.737424 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.737508 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.737508 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.737677 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.737771 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.737857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.738026 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.738145 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.738358 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.738467 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.738670 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.738766 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.738942 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.739038 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.739274 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.739388 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.739575 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.739683 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.739887 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.739988 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.740214 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.740330 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.740522 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.740626 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.740832 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.740933 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.741144 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.741254 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.741449 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.741555 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.741760 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.741859 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.742065 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.742174 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.742373 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.742470 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.742677 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.742779 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.742996 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.743102 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.743344 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.743445 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.743661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.743795 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.743979 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.744128 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.744296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.744428 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.744608 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.744914 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.745047 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.745245 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.745358 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.745807 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.745922 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.746037 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.746140 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.746230 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.746316 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.746493 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.746615 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.746809 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.746919 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.747159 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.747271 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.747472 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.747569 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.747792 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.747899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.748111 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.748214 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.748437 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.749114 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.749562 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.749701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.749940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.750090 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.750267 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.750404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.750588 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.750732 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.750921 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.751061 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.751297 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.751446 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.751580 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.751816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.751965 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.752108 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.752241 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.752387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.752528 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.752660 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.752792 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.752923 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.753100 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.753251 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.753423 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.753568 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.753744 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.753901 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.754066 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.754211 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.754386 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.754550 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.754885 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.755031 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.755252 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.755396 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.755538 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.755679 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.755811 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.755952 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.756100 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.756239 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.756386 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.756519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.756639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.756772 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.756903 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.757042 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.757233 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.757371 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.757546 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.757690 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.757864 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.758000 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.758181 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.758324 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.758493 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.758642 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.758809 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.758943 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.759146 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.759294 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.759516 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.759651 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.759783 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.759914 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.760082 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.760226 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.760401 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.760548 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.760731 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.760873 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.761050 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.761186 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.761375 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.761513 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.761694 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.761831 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.762071 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.762220 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.762403 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.762547 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.762734 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.762881 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.763056 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.763254 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.763397 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.763537 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.763718 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.763855 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.764058 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.764220 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.765067 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.765205 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.765321 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.765443 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.765574 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.765689 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.765881 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.766010 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.766190 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.766332 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.766500 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.766635 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.766815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.766969 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.767523 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.767678 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.767826 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.767960 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.768228 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.768365 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.768497 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.768636 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.768636 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.768907 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.769068 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.769203 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.769343 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.769485 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.769618 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.769749 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.769889 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.769889 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.770155 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.770296 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.770428 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.770560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.770700 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.770841 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.770975 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.771120 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.771285 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.771419 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.771550 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.771691 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.771824 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.771965 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.772107 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.772270 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.772414 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.772582 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.772729 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.772896 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.773032 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.773436 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.773592 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.773592 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.773907 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.774056 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.774189 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.774310 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.774440 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.774690 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.774843 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.775103 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.775267 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.775400 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.775544 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.775677 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.775823 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.775962 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.776083 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.776222 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.776362 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.776504 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.776636 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.776768 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.776906 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.777036 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.777174 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.777317 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.777457 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.777590 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.777720 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.777852 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.777982 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.778124 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.778346 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.778483 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.778622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.778754 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.778885 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.779026 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.779185 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.779329 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.779462 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.779601 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.779800 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.779958 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.780143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.780279 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.780477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.780621 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.780805 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.780944 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.781132 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.781274 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.781456 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.781598 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.781769 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.781904 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.782108 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.782243 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.782426 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.782571 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.782743 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.782962 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.783106 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.783332 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.783468 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.783658 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.783796 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.783998 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.784143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.784333 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.784459 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.784644 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.784779 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.784956 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.785107 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.785310 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.785445 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.785579 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.785701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.785887 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.786033 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.786205 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.786352 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.786521 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.786657 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.786838 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.786974 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.787171 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.787324 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.787490 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.787627 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.787807 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.787950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.788124 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.788273 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.788476 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117492) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 17:25:55.788612 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.788744 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.789040 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.789354 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.789672 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.790018 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.790344 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.790668 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.790990 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.791343 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.791661 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.791979 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.792295 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.792610 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.792932 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.793268 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.793586 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.793894 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.794323 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.794644 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.794971 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.795331 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.795821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.796403 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.796905 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.797389 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.797879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.798316 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.798659 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.799002 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.799373 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.799709 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.800025 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.800340 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.800652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.800971 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.801308 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.801627 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.801940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.802253 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.802569 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.802879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.803221 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.803537 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.803853 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.804169 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.804482 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.804793 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.805103 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.805418 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.805729 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.806042 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.806361 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.806925 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.807401 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.807401 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.807886 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.807886 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.808223 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.808575 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.808885 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.809215 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.809532 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.809861 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.810176 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.810503 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.810831 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.811706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.812024 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.812364 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.812622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_db.sqlalchemy.engines [None req-d2b35731-e926-495e-bd97-75786898f815 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117492) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 17:25:55.812735 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.812987 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.813305 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.813622 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.813937 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.814251 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.814585 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.814918 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.815257 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.815594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.815917 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.816245 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.816568 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.816887 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.817226 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.817545 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.817864 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.818188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.818508 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.818829 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.819169 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.819497 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.819831 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.820166 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.820482 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.820816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.821147 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.821502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.821829 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.822181 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.822515 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.822837 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.823174 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.823491 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 13 17:25:55.823739 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117493) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 13 17:25:55.847355 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_db.sqlalchemy.engines [None req-ea4349f5-ebfd-4ac1-8141-d43062571671 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117493) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 17:25:55.877347 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.context [None req-d2b35731-e926-495e-bd97-75786898f815 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b14dab8a-67db-465f-b07a-be88db818145(cell1) {{(pid=117492) load_cells /opt/stack/nova/nova/context.py:464}} May 13 17:25:55.881719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d2b35731-e926-495e-bd97-75786898f815 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:25:55.883366 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d2b35731-e926-495e-bd97-75786898f815 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:25:55.884183 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d2b35731-e926-495e-bd97-75786898f815 None None] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:25:55.886279 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d2b35731-e926-495e-bd97-75786898f815 None None] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:25:55.898411 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_db.sqlalchemy.engines [None req-d2b35731-e926-495e-bd97-75786898f815 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117492) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 17:25:55.899732 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_db.sqlalchemy.engines [None req-d2b35731-e926-495e-bd97-75786898f815 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117492) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 17:25:55.911889 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.context [None req-ea4349f5-ebfd-4ac1-8141-d43062571671 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b14dab8a-67db-465f-b07a-be88db818145(cell1) {{(pid=117493) load_cells /opt/stack/nova/nova/context.py:464}} May 13 17:25:55.916268 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ea4349f5-ebfd-4ac1-8141-d43062571671 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:25:55.917861 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ea4349f5-ebfd-4ac1-8141-d43062571671 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:25:55.918672 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ea4349f5-ebfd-4ac1-8141-d43062571671 None None] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:25:55.921364 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ea4349f5-ebfd-4ac1-8141-d43062571671 None None] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:25:55.935882 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_db.sqlalchemy.engines [None req-ea4349f5-ebfd-4ac1-8141-d43062571671 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117493) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 17:25:55.938276 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_db.sqlalchemy.engines [None req-ea4349f5-ebfd-4ac1-8141-d43062571671 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117493) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 17:25:56.068655 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_db.sqlalchemy.engines [None req-d2b35731-e926-495e-bd97-75786898f815 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117492) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 17:25:56.096192 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_db.sqlalchemy.engines [None req-ea4349f5-ebfd-4ac1-8141-d43062571671 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117493) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 13 17:25:56.390430 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: WARNING keystonemiddleware.auth_token [None req-d2b35731-e926-495e-bd97-75786898f815 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 17:25:56.398656 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: WARNING keystonemiddleware.auth_token [None req-d2b35731-e926-495e-bd97-75786898f815 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 17:25:56.423566 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: WARNING keystonemiddleware.auth_token [None req-ea4349f5-ebfd-4ac1-8141-d43062571671 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 17:25:56.438317 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: WARNING keystonemiddleware.auth_token [None req-ea4349f5-ebfd-4ac1-8141-d43062571671 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 17:25:56.749346 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: WARNING keystonemiddleware.auth_token [None req-d2b35731-e926-495e-bd97-75786898f815 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 17:25:56.755627 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: WARNING keystonemiddleware.auth_token [None req-d2b35731-e926-495e-bd97-75786898f815 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 17:25:56.761239 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5561c41179c0 pid: 117492 (default app) May 13 17:25:56.788463 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: WARNING keystonemiddleware.auth_token [None req-ea4349f5-ebfd-4ac1-8141-d43062571671 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 13 17:25:56.794787 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: WARNING keystonemiddleware.auth_token [None req-ea4349f5-ebfd-4ac1-8141-d43062571671 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 13 17:25:56.800766 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5561c41179c0 pid: 117493 (default app) May 13 17:26:40.241287 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d2dff707-22d1-4955-a547-d37960191eb4 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] Action: 'create', calling method: .version_select at 0x7fa086b4d280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1961201048", "metadata": {"Type": "work"}}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:26:40.263414 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d2dff707-22d1-4955-a547-d37960191eb4 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] Request method failure captured: May 13 17:26:40.263414 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 13 17:26:40.263414 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:26:40.263414 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:26:40.263414 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:26:40.263414 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 122 May 13 17:26:40.263414 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:26:40.263414 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:26:40.263414 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:26:40.263414 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:26:40.263414 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpTOfbFQC7bLEo1cenuFJQhLZwAYleMex-evnwGtmXUqoApbCSxI61V6uEy5Ul5UhxZTnHpkg7AHLKC6chDXRR3VRoJWXY8VleuNCJIyQvaY4Jq6AU7LgH8GRQCYIyw7xYa8hKb65cjo_g4y8djps5GYz_RCrxpLrEuwUnFF9Q0ZZJg May 13 17:26:40.263414 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:26:40.263414 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:26:40.263414 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:26:40.263414 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:26:40.263414 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:26:40.263414 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:26:40.263414 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: 21feba785ece4f3fb703519584e760f7 May 13 17:26:40.263414 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-VolumesNegativeTest-1268370743 May 13 17:26:40.263414 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:26:40.263414 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:26:40.265056 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/21feba785ece4f3fb703519584e760f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/21feba785ece4f3fb703519584e760f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_21feba785ece4f3fb703519584e760f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/21feba785ece4f3fb703519584e760f7"}]}] May 13 17:26:40.265056 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-VolumesNegativeTest-1268370743 May 13 17:26:40.265056 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: 21feba785ece4f3fb703519584e760f7 May 13 17:26:40.265056 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-VolumesNegativeTest-1268370743 May 13 17:26:40.265056 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-VolumesNegativeTest-1268370743-project May 13 17:26:40.265056 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:26:40.265056 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:26:40.265056 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: cd48fac53626402192e203cf80cfc22f May 13 17:26:40.265056 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-VolumesNegativeTest-1268370743-project May 13 17:26:40.265056 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: May 13 17:26:40.265056 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1961201048", "metadata": {"Type": "work"}}} May 13 17:26:40.265056 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: May 13 17:26:40.265056 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 13 17:26:40.266639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1961201048', 'metadata': {'Type': 'work'}}}} May 13 17:26:40.266639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:26:40.266639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:26:40.266639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 13 17:26:40.266639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 13 17:26:40.266639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 13 17:26:40.266639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise error May 13 17:26:40.266639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 13 17:26:40.266639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.266639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 13 17:26:40.266639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 13 17:26:40.266639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.266639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi On instance['volume']: May 13 17:26:40.266639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi '#$%' May 13 17:26:40.266639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.266639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:26:40.266639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.266639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:26:40.266639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:26:40.266639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:26:40.266639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:26:40.266639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:26:40.268664 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 17:26:40.268664 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 17:26:40.268664 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:26:40.268664 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:26:40.268664 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 13 17:26:40.268664 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 13 17:26:40.268664 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 13 17:26:40.268664 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 13 17:26:40.268664 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 13 17:26:40.268664 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 13 17:26:40.268664 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 13 17:26:40.268664 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.268664 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:26:40.268664 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.268664 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:26:40.268664 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:26:40.268664 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:26:40.268664 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 13 17:26:40.268664 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 13 17:26:40.269904 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 13 17:26:40.269904 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.269904 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d2dff707-22d1-4955-a547-d37960191eb4 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:26:40.269904 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d2dff707-22d1-4955-a547-d37960191eb4 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.175276 May 13 17:26:40.269904 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 1/1] 10.222.0.64 () {60 vars in 1155 bytes} [Fri May 13 17:26:39 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1178 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 17:26:40.282274 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-31b4b41c-eb8f-4075-81a6-a97d9e638b11 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] Action: 'create', calling method: .version_select at 0x7fa0869e25e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1107408039", "metadata": {"Type": "work"}}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:26:40.285194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-31b4b41c-eb8f-4075-81a6-a97d9e638b11 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] Request method failure captured: May 13 17:26:40.285194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 13 17:26:40.285194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:26:40.285194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:26:40.285194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:26:40.285194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 120 May 13 17:26:40.285194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:26:40.285194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:26:40.285194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:26:40.285194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:26:40.285194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpTOfbFQC7bLEo1cenuFJQhLZwAYleMex-evnwGtmXUqoApbCSxI61V6uEy5Ul5UhxZTnHpkg7AHLKC6chDXRR3VRoJWXY8VleuNCJIyQvaY4Jq6AU7LgH8GRQCYIyw7xYa8hKb65cjo_g4y8djps5GYz_RCrxpLrEuwUnFF9Q0ZZJg May 13 17:26:40.285194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:26:40.285194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:26:40.285194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:26:40.285194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:26:40.285194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:26:40.285194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:26:40.285194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: 21feba785ece4f3fb703519584e760f7 May 13 17:26:40.285194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-VolumesNegativeTest-1268370743 May 13 17:26:40.285194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:26:40.285194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:26:40.286636 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/21feba785ece4f3fb703519584e760f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/21feba785ece4f3fb703519584e760f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_21feba785ece4f3fb703519584e760f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/21feba785ece4f3fb703519584e760f7"}]}] May 13 17:26:40.286636 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-VolumesNegativeTest-1268370743 May 13 17:26:40.286636 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: 21feba785ece4f3fb703519584e760f7 May 13 17:26:40.286636 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-VolumesNegativeTest-1268370743 May 13 17:26:40.286636 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-VolumesNegativeTest-1268370743-project May 13 17:26:40.286636 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:26:40.286636 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:26:40.286636 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: cd48fac53626402192e203cf80cfc22f May 13 17:26:40.286636 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-VolumesNegativeTest-1268370743-project May 13 17:26:40.286636 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: May 13 17:26:40.286636 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1107408039", "metadata": {"Type": "work"}}} May 13 17:26:40.286636 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: May 13 17:26:40.286636 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 13 17:26:40.294345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1107408039', 'metadata': {'Type': 'work'}}}} May 13 17:26:40.294345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:26:40.294345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:26:40.294345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 13 17:26:40.294345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 13 17:26:40.294345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 13 17:26:40.294345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise error May 13 17:26:40.294345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 13 17:26:40.294345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.294345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 13 17:26:40.294345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 13 17:26:40.294345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.294345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi On instance['volume']: May 13 17:26:40.294345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi '0' May 13 17:26:40.294345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.294345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:26:40.294345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.294345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:26:40.294345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:26:40.294345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:26:40.294345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:26:40.294345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:26:40.297560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 17:26:40.297560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 17:26:40.297560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:26:40.297560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:26:40.297560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 13 17:26:40.297560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 13 17:26:40.297560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 13 17:26:40.297560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 13 17:26:40.297560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 13 17:26:40.297560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 13 17:26:40.297560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 13 17:26:40.297560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.297560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:26:40.297560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.297560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:26:40.297560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:26:40.297560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:26:40.297560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 13 17:26:40.297560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 13 17:26:40.299291 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 13 17:26:40.299291 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.299291 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-31b4b41c-eb8f-4075-81a6-a97d9e638b11 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:26:40.299291 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-31b4b41c-eb8f-4075-81a6-a97d9e638b11 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.016179 May 13 17:26:40.299291 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 2/2] 10.222.0.64 () {60 vars in 1155 bytes} [Fri May 13 17:26:40 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 17:26:40.324274 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-29d50ca9-2f23-40ce-ae15-4630cbdc1ea4 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] Action: 'create', calling method: .version_select at 0x7fa086b4d5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1368904619", "metadata": {"Type": "work"}}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:26:40.326887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-29d50ca9-2f23-40ce-ae15-4630cbdc1ea4 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] Request method failure captured: May 13 17:26:40.326887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 13 17:26:40.326887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:26:40.326887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:26:40.326887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:26:40.326887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 119 May 13 17:26:40.326887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:26:40.326887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:26:40.326887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:26:40.326887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:26:40.326887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpTOfbFQC7bLEo1cenuFJQhLZwAYleMex-evnwGtmXUqoApbCSxI61V6uEy5Ul5UhxZTnHpkg7AHLKC6chDXRR3VRoJWXY8VleuNCJIyQvaY4Jq6AU7LgH8GRQCYIyw7xYa8hKb65cjo_g4y8djps5GYz_RCrxpLrEuwUnFF9Q0ZZJg May 13 17:26:40.326887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:26:40.326887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:26:40.326887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:26:40.326887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:26:40.326887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:26:40.326887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:26:40.326887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: 21feba785ece4f3fb703519584e760f7 May 13 17:26:40.326887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-VolumesNegativeTest-1268370743 May 13 17:26:40.326887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:26:40.326887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:26:40.329071 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/21feba785ece4f3fb703519584e760f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/21feba785ece4f3fb703519584e760f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_21feba785ece4f3fb703519584e760f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/21feba785ece4f3fb703519584e760f7"}]}] May 13 17:26:40.329071 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-VolumesNegativeTest-1268370743 May 13 17:26:40.329071 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: 21feba785ece4f3fb703519584e760f7 May 13 17:26:40.329071 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-VolumesNegativeTest-1268370743 May 13 17:26:40.329071 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-VolumesNegativeTest-1268370743-project May 13 17:26:40.329071 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:26:40.329071 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:26:40.329071 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: cd48fac53626402192e203cf80cfc22f May 13 17:26:40.329071 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-VolumesNegativeTest-1268370743-project May 13 17:26:40.329071 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: May 13 17:26:40.329071 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1368904619", "metadata": {"Type": "work"}}} May 13 17:26:40.329071 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: May 13 17:26:40.329071 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 13 17:26:40.330017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1368904619', 'metadata': {'Type': 'work'}}}} May 13 17:26:40.330017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:26:40.330017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:26:40.330017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 13 17:26:40.330017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 13 17:26:40.330017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 13 17:26:40.330017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise error May 13 17:26:40.330017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 13 17:26:40.330017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.330017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 13 17:26:40.330017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 13 17:26:40.330017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.330017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi On instance['volume']: May 13 17:26:40.330017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi '' May 13 17:26:40.330017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.330017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:26:40.330017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.330017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:26:40.330017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:26:40.330017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:26:40.330017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:26:40.330017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:26:40.331705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 17:26:40.331705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 17:26:40.331705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:26:40.331705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:26:40.331705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 13 17:26:40.331705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 13 17:26:40.331705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 13 17:26:40.331705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 13 17:26:40.331705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 13 17:26:40.331705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 13 17:26:40.331705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 13 17:26:40.331705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.331705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:26:40.331705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.331705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:26:40.331705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:26:40.331705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:26:40.331705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 13 17:26:40.331705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 13 17:26:40.337950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 13 17:26:40.337950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.337950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-29d50ca9-2f23-40ce-ae15-4630cbdc1ea4 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:26:40.337950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-29d50ca9-2f23-40ce-ae15-4630cbdc1ea4 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.034047 May 13 17:26:40.337950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 3/3] 10.222.0.64 () {60 vars in 1155 bytes} [Fri May 13 17:26:40 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 36 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 17:26:40.357746 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f6a5994c-fd5c-480b-b146-e51356d2bce6 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] Calling method '.version_select at 0x7fa086a02280>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:40.551753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3381c5b2-664f-4934-9597-38d165d80ee4 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Action: 'create', calling method: .version_select at 0x7fa086b4e280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1062366617"}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:26:40.940175 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-f6a5994c-fd5c-480b-b146-e51356d2bce6 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] HTTP exception thrown: Volume tempest-invalid-903657744 could not be found. May 13 17:26:40.944135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f6a5994c-fd5c-480b-b146-e51356d2bce6 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] Request method failure captured: May 13 17:26:40.944135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-903657744 HTTP/1.1 May 13 17:26:40.944135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:26:40.944135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:26:40.944135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:26:40.944135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 0 May 13 17:26:40.944135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:26:40.944135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:26:40.944135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:26:40.944135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:26:40.944135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpTOfbFQC7bLEo1cenuFJQhLZwAYleMex-evnwGtmXUqoApbCSxI61V6uEy5Ul5UhxZTnHpkg7AHLKC6chDXRR3VRoJWXY8VleuNCJIyQvaY4Jq6AU7LgH8GRQCYIyw7xYa8hKb65cjo_g4y8djps5GYz_RCrxpLrEuwUnFF9Q0ZZJg May 13 17:26:40.944135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:26:40.944135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:26:40.944135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:26:40.944135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:26:40.944135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:26:40.944135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:26:40.944135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: 21feba785ece4f3fb703519584e760f7 May 13 17:26:40.944135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-VolumesNegativeTest-1268370743 May 13 17:26:40.944135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:26:40.944135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:26:40.945650 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/21feba785ece4f3fb703519584e760f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/21feba785ece4f3fb703519584e760f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_21feba785ece4f3fb703519584e760f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/21feba785ece4f3fb703519584e760f7"}]}] May 13 17:26:40.945650 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-VolumesNegativeTest-1268370743 May 13 17:26:40.945650 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: 21feba785ece4f3fb703519584e760f7 May 13 17:26:40.945650 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-VolumesNegativeTest-1268370743 May 13 17:26:40.945650 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-VolumesNegativeTest-1268370743-project May 13 17:26:40.945650 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:26:40.945650 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:26:40.945650 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: cd48fac53626402192e203cf80cfc22f May 13 17:26:40.945650 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-VolumesNegativeTest-1268370743-project May 13 17:26:40.945650 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: May 13 17:26:40.945650 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Volume tempest-invalid-903657744 could not be found. May 13 17:26:40.945650 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'id': 'tempest-invalid-903657744'} May 13 17:26:40.945650 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:26:40.946630 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:26:40.946630 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 17:26:40.946630 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 17:26:40.946630 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 17:26:40.946630 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 17:26:40.946630 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 17:26:40.946630 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 17:26:40.946630 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 17:26:40.946630 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 17:26:40.946630 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 17:26:40.946630 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 17:26:40.946630 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 17:26:40.946630 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 17:26:40.946630 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 17:26:40.946630 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 17:26:40.946630 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-903657744 could not be found. (HTTP 404) (Request-ID: req-2011e68f-9f71-42d0-8007-ca7ad63fac94) May 13 17:26:40.946630 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.946630 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:26:40.946630 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.948068 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:26:40.948068 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 13 17:26:40.948068 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 13 17:26:40.948068 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 17:26:40.948068 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 17:26:40.948068 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 17:26:40.948068 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 17:26:40.948068 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 17:26:40.948068 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 17:26:40.948068 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 17:26:40.948068 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 17:26:40.948068 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 17:26:40.948068 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 17:26:40.948068 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 17:26:40.948068 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 17:26:40.948068 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 17:26:40.948068 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 17:26:40.948068 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 17:26:40.948068 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 17:26:40.949431 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 17:26:40.949431 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 17:26:40.949431 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 17:26:40.949431 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 17:26:40.949431 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-903657744 could not be found. May 13 17:26:40.949431 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.949431 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:26:40.949431 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.949431 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:26:40.949431 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:26:40.949431 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:26:40.949431 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:26:40.949431 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:26:40.949431 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 17:26:40.949431 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 17:26:40.949431 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:26:40.949431 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:26:40.949431 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 13 17:26:40.949431 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:26:40.949431 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-903657744 could not be found. May 13 17:26:40.950925 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.950925 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:26:40.950925 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.950925 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:26:40.950925 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:26:40.950925 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:26:40.950925 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:26:40.950925 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:26:40.950925 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-903657744 could not be found. May 13 17:26:40.950925 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:40.958053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f6a5994c-fd5c-480b-b146-e51356d2bce6 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] Returning 404 to user: Volume tempest-invalid-903657744 could not be found. {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:26:40.958053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f6a5994c-fd5c-480b-b146-e51356d2bce6 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/tempest-invalid-903657744" status: 404 len: 98 microversion: 2.1 time: 0.607730 May 13 17:26:40.958698 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 4/4] 10.222.0.64 () {58 vars in 1214 bytes} [Fri May 13 17:26:40 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-903657744 => generated 98 bytes in 619 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 13 17:26:40.964467 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-5893b497-91f6-42d5-838a-fb1d936840be tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004299 May 13 17:26:40.964995 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 5/5] 10.222.0.64 () {58 vars in 1139 bytes} [Fri May 13 17:26:40 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 13 17:26:40.975145 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-e469d845-9fd0-4331-a0c1-3ff44a7598b5 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003961 May 13 17:26:40.980690 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 6/6] 10.222.0.64 () {58 vars in 1136 bytes} [Fri May 13 17:26:40 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 10 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 13 17:26:40.986782 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-56a05bb8-3a43-4513-90c3-6311264009e3 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] Calling method '.version_select at 0x7fa08692a1f0>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:41.039687 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-56a05bb8-3a43-4513-90c3-6311264009e3 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] HTTP exception thrown: Volume 3e3c5666-df3e-4950-bd5c-715645b8b3cf could not be found. May 13 17:26:41.042115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-56a05bb8-3a43-4513-90c3-6311264009e3 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] Request method failure captured: May 13 17:26:41.042115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: DELETE /compute/v2.1/os-volumes/3e3c5666-df3e-4950-bd5c-715645b8b3cf HTTP/1.1 May 13 17:26:41.042115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:26:41.042115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:26:41.042115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:26:41.042115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 0 May 13 17:26:41.042115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:26:41.042115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:26:41.042115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:26:41.042115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:26:41.042115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpTOfbFQC7bLEo1cenuFJQhLZwAYleMex-evnwGtmXUqoApbCSxI61V6uEy5Ul5UhxZTnHpkg7AHLKC6chDXRR3VRoJWXY8VleuNCJIyQvaY4Jq6AU7LgH8GRQCYIyw7xYa8hKb65cjo_g4y8djps5GYz_RCrxpLrEuwUnFF9Q0ZZJg May 13 17:26:41.042115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:26:41.042115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:26:41.042115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:26:41.042115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:26:41.042115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:26:41.042115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:26:41.042115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: 21feba785ece4f3fb703519584e760f7 May 13 17:26:41.042115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-VolumesNegativeTest-1268370743 May 13 17:26:41.042115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:26:41.042115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:26:41.046322 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/21feba785ece4f3fb703519584e760f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/21feba785ece4f3fb703519584e760f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_21feba785ece4f3fb703519584e760f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/21feba785ece4f3fb703519584e760f7"}]}] May 13 17:26:41.046322 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-VolumesNegativeTest-1268370743 May 13 17:26:41.046322 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: 21feba785ece4f3fb703519584e760f7 May 13 17:26:41.046322 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-VolumesNegativeTest-1268370743 May 13 17:26:41.046322 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-VolumesNegativeTest-1268370743-project May 13 17:26:41.046322 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:26:41.046322 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:26:41.046322 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: cd48fac53626402192e203cf80cfc22f May 13 17:26:41.046322 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-VolumesNegativeTest-1268370743-project May 13 17:26:41.046322 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: May 13 17:26:41.046322 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Volume 3e3c5666-df3e-4950-bd5c-715645b8b3cf could not be found. May 13 17:26:41.046322 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'id': '3e3c5666-df3e-4950-bd5c-715645b8b3cf'} May 13 17:26:41.046322 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:26:41.047899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:26:41.047899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 17:26:41.047899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 17:26:41.047899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 17:26:41.047899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 17:26:41.047899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 17:26:41.047899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 17:26:41.047899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 17:26:41.047899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 17:26:41.047899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 17:26:41.047899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 17:26:41.047899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 17:26:41.047899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 17:26:41.047899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 17:26:41.047899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 17:26:41.047899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3e3c5666-df3e-4950-bd5c-715645b8b3cf could not be found. (HTTP 404) (Request-ID: req-db332a75-011e-4859-931e-3ec7aef803ee) May 13 17:26:41.047899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:41.047899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:26:41.047899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:41.049240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:26:41.049240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 13 17:26:41.049240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 13 17:26:41.049240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 17:26:41.049240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 17:26:41.049240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 17:26:41.049240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 17:26:41.049240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 17:26:41.049240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 17:26:41.049240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 17:26:41.049240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 17:26:41.049240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 17:26:41.049240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 17:26:41.049240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 17:26:41.049240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 17:26:41.049240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 17:26:41.049240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 17:26:41.049240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 17:26:41.049240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 17:26:41.050489 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 17:26:41.050489 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 17:26:41.050489 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 17:26:41.050489 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 17:26:41.050489 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3e3c5666-df3e-4950-bd5c-715645b8b3cf could not be found. May 13 17:26:41.050489 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:41.050489 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:26:41.050489 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:41.050489 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:26:41.050489 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:26:41.050489 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:26:41.050489 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:26:41.050489 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:26:41.050489 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 17:26:41.050489 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 17:26:41.050489 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:26:41.050489 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:26:41.050489 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 13 17:26:41.050489 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:26:41.051957 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3e3c5666-df3e-4950-bd5c-715645b8b3cf could not be found. May 13 17:26:41.051957 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:41.051957 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:26:41.051957 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:41.051957 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:26:41.051957 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:26:41.051957 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:26:41.051957 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:26:41.051957 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:26:41.051957 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3e3c5666-df3e-4950-bd5c-715645b8b3cf could not be found. May 13 17:26:41.051957 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:41.051957 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-56a05bb8-3a43-4513-90c3-6311264009e3 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] Returning 404 to user: Volume 3e3c5666-df3e-4950-bd5c-715645b8b3cf could not be found. {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:26:41.051957 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-56a05bb8-3a43-4513-90c3-6311264009e3 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/3e3c5666-df3e-4950-bd5c-715645b8b3cf" status: 404 len: 109 microversion: 2.1 time: 0.061553 May 13 17:26:41.051957 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 7/7] 10.222.0.64 () {58 vars in 1247 bytes} [Fri May 13 17:26:40 2022] DELETE /compute/v2.1/os-volumes/3e3c5666-df3e-4950-bd5c-715645b8b3cf => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:26:41.054323 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f41b6991-af13-4c62-ae6e-149aa05f08a3 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] Calling method '.version_select at 0x7fa08692a430>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:41.254339 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-f41b6991-af13-4c62-ae6e-149aa05f08a3 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] HTTP exception thrown: Volume 4f980055-699f-4f98-a151-81bd4e48f8d6 could not be found. May 13 17:26:41.257053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f41b6991-af13-4c62-ae6e-149aa05f08a3 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] Request method failure captured: May 13 17:26:41.257053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: GET /compute/v2.1/os-volumes/4f980055-699f-4f98-a151-81bd4e48f8d6 HTTP/1.1 May 13 17:26:41.257053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:26:41.257053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:26:41.257053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:26:41.257053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 0 May 13 17:26:41.257053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:26:41.257053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:26:41.257053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:26:41.257053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:26:41.257053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpTOfbFQC7bLEo1cenuFJQhLZwAYleMex-evnwGtmXUqoApbCSxI61V6uEy5Ul5UhxZTnHpkg7AHLKC6chDXRR3VRoJWXY8VleuNCJIyQvaY4Jq6AU7LgH8GRQCYIyw7xYa8hKb65cjo_g4y8djps5GYz_RCrxpLrEuwUnFF9Q0ZZJg May 13 17:26:41.257053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:26:41.257053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:26:41.257053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:26:41.257053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:26:41.257053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:26:41.257053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:26:41.257053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: 21feba785ece4f3fb703519584e760f7 May 13 17:26:41.257053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-VolumesNegativeTest-1268370743 May 13 17:26:41.257053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:26:41.257053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:26:41.258500 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/21feba785ece4f3fb703519584e760f7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/21feba785ece4f3fb703519584e760f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_21feba785ece4f3fb703519584e760f7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/21feba785ece4f3fb703519584e760f7"}]}] May 13 17:26:41.258500 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-VolumesNegativeTest-1268370743 May 13 17:26:41.258500 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: 21feba785ece4f3fb703519584e760f7 May 13 17:26:41.258500 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-VolumesNegativeTest-1268370743 May 13 17:26:41.258500 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-VolumesNegativeTest-1268370743-project May 13 17:26:41.258500 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:26:41.258500 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:26:41.258500 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: cd48fac53626402192e203cf80cfc22f May 13 17:26:41.258500 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-VolumesNegativeTest-1268370743-project May 13 17:26:41.258500 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: May 13 17:26:41.258500 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Volume 4f980055-699f-4f98-a151-81bd4e48f8d6 could not be found. May 13 17:26:41.258500 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'id': '4f980055-699f-4f98-a151-81bd4e48f8d6'} May 13 17:26:41.258500 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:26:41.259644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:26:41.259644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 17:26:41.259644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 17:26:41.259644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 17:26:41.259644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 17:26:41.259644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 17:26:41.259644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 17:26:41.259644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 17:26:41.259644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 17:26:41.259644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 17:26:41.259644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 17:26:41.259644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 17:26:41.259644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 17:26:41.259644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 17:26:41.259644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 17:26:41.259644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 4f980055-699f-4f98-a151-81bd4e48f8d6 could not be found. (HTTP 404) (Request-ID: req-0ba46c36-bdca-4b35-8938-becde67d7727) May 13 17:26:41.259644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:41.259644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:26:41.259644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:41.261130 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:26:41.261130 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 17:26:41.261130 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 17:26:41.261130 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 17:26:41.261130 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 17:26:41.261130 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 17:26:41.261130 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 17:26:41.261130 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 17:26:41.261130 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 17:26:41.261130 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 17:26:41.261130 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 17:26:41.261130 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 17:26:41.261130 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 17:26:41.261130 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 17:26:41.261130 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 17:26:41.261130 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 17:26:41.261130 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 17:26:41.261130 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 17:26:41.261130 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 17:26:41.262465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 17:26:41.262465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 17:26:41.262465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 17:26:41.262465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 17:26:41.262465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 4f980055-699f-4f98-a151-81bd4e48f8d6 could not be found. May 13 17:26:41.262465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:41.262465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:26:41.262465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:41.262465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:26:41.262465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:26:41.262465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:26:41.262465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:26:41.262465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:26:41.262465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 17:26:41.262465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 17:26:41.262465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:26:41.262465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:26:41.262465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 17:26:41.262465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:26:41.263950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 4f980055-699f-4f98-a151-81bd4e48f8d6 could not be found. May 13 17:26:41.263950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:41.263950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:26:41.263950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:41.263950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:26:41.263950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:26:41.263950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:26:41.263950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:26:41.263950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:26:41.263950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 4f980055-699f-4f98-a151-81bd4e48f8d6 could not be found. May 13 17:26:41.263950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:26:41.266326 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f41b6991-af13-4c62-ae6e-149aa05f08a3 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] Returning 404 to user: Volume 4f980055-699f-4f98-a151-81bd4e48f8d6 could not be found. {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:26:41.267417 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f41b6991-af13-4c62-ae6e-149aa05f08a3 tempest-VolumesNegativeTest-1268370743 tempest-VolumesNegativeTest-1268370743-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/4f980055-699f-4f98-a151-81bd4e48f8d6" status: 404 len: 109 microversion: 2.1 time: 0.217340 May 13 17:26:41.268827 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 8/8] 10.222.0.64 () {58 vars in 1244 bytes} [Fri May 13 17:26:41 2022] GET /compute/v2.1/os-volumes/4f980055-699f-4f98-a151-81bd4e48f8d6 => generated 109 bytes in 219 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:26:42.276670 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3381c5b2-664f-4934-9597-38d165d80ee4 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.618123 May 13 17:26:42.288467 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 1/9] 10.222.0.64 () {60 vars in 1154 bytes} [Fri May 13 17:26:39 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2626 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 13 17:26:42.291614 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a6e5496d-cf8c-42f1-84c3-8a138eb88776 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Calling method '.version_select at 0x7fa086a19280>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:42.484680 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a6e5496d-cf8c-42f1-84c3-8a138eb88776 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/3ea00bea-a861-4ffa-9437-6d5e26d6c152" status: 200 len: 345 microversion: 2.1 time: 0.196154 May 13 17:26:42.484680 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 2/10] 10.222.0.64 () {58 vars in 1244 bytes} [Fri May 13 17:26:42 2022] GET /compute/v2.1/os-volumes/3ea00bea-a861-4ffa-9437-6d5e26d6c152 => generated 345 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:26:42.491962 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6c3e0784-928d-4123-a873-2b5a41f30d6e tempest-VolumesTestJSON-1603157422 tempest-VolumesTestJSON-1603157422-project] Calling method '.version_select at 0x7fa086a194c0>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:42.621016 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6c3e0784-928d-4123-a873-2b5a41f30d6e tempest-VolumesTestJSON-1603157422 tempest-VolumesTestJSON-1603157422-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/54475780-4873-43ca-a1f7-20e29541f991" status: 200 len: 351 microversion: 2.1 time: 0.133749 May 13 17:26:42.621506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 3/11] 10.222.0.64 () {58 vars in 1244 bytes} [Fri May 13 17:26:42 2022] GET /compute/v2.1/os-volumes/54475780-4873-43ca-a1f7-20e29541f991 => generated 351 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:26:42.640013 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b0101d91-9207-4d66-a768-1ab4a47ce494 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1042557930", "imageRef": "7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88", "flavorRef": "452", "networks": [{"uuid": "bfa87f57-69c9-476e-a1ac-3f41f2881fe9"}]}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:26:42.860651 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.network.neutron [None req-b0101d91-9207-4d66-a768-1ab4a47ce494 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] validate_networks() for [('bfa87f57-69c9-476e-a1ac-3f41f2881fe9', None, None, None, None, None)] {{(pid=117492) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 17:26:43.502572 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a8712ed9-27cc-4c01-997a-a0c5445c6a9d tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Calling method '.version_select at 0x7fa086a19a60>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:43.802646 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a8712ed9-27cc-4c01-997a-a0c5445c6a9d tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/3ea00bea-a861-4ffa-9437-6d5e26d6c152" status: 200 len: 345 microversion: 2.1 time: 0.082950 May 13 17:26:43.802646 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 4/12] 10.222.0.64 () {58 vars in 1244 bytes} [Fri May 13 17:26:43 2022] GET /compute/v2.1/os-volumes/3ea00bea-a861-4ffa-9437-6d5e26d6c152 => generated 345 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:26:44.594152 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1df2ff7f-58f0-4f15-94fb-e1d8430b85e5 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Calling method '.version_select at 0x7fa0869ad160>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:44.727739 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1df2ff7f-58f0-4f15-94fb-e1d8430b85e5 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/3ea00bea-a861-4ffa-9437-6d5e26d6c152" status: 200 len: 346 microversion: 2.1 time: 0.137742 May 13 17:26:44.737833 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 5/13] 10.222.0.64 () {58 vars in 1244 bytes} [Fri May 13 17:26:44 2022] GET /compute/v2.1/os-volumes/3ea00bea-a861-4ffa-9437-6d5e26d6c152 => generated 346 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:26:44.744619 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0ceed553-5442-4a5f-9415-ecc282c393b3 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Action: 'create', calling method: .version_select at 0x7fa086a19dc0>, body: {"snapshot": {"volume_id": "3ea00bea-a861-4ffa-9437-6d5e26d6c152", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-409987132"}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:26:45.202337 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-b0101d91-9207-4d66-a768-1ab4a47ce494 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Flavor limits 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 17:26:45.202907 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-b0101d91-9207-4d66-a768-1ab4a47ce494 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Image limits 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 17:26:45.203450 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-b0101d91-9207-4d66-a768-1ab4a47ce494 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Flavor pref 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 17:26:45.204135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-b0101d91-9207-4d66-a768-1ab4a47ce494 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Image pref 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 17:26:45.204546 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-b0101d91-9207-4d66-a768-1ab4a47ce494 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 17:26:45.229977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b0101d91-9207-4d66-a768-1ab4a47ce494 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:26:45.230435 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b0101d91-9207-4d66-a768-1ab4a47ce494 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:26:45.231271 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b0101d91-9207-4d66-a768-1ab4a47ce494 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:26:45.231706 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b0101d91-9207-4d66-a768-1ab4a47ce494 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:26:45.290427 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-b0101d91-9207-4d66-a768-1ab4a47ce494 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Getting quotas for project 7123f57c394d4a35b46f5bf62d48abb7. Resources: {'ram', 'instances', 'cores'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:26:45.298350 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-b0101d91-9207-4d66-a768-1ab4a47ce494 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Getting quotas for user af2ddeccca5547bfa8ad3804e9041b65 and project 7123f57c394d4a35b46f5bf62d48abb7. Resources: {'ram', 'instances', 'cores'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:26:45.309878 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b0101d91-9207-4d66-a768-1ab4a47ce494 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Going to run 1 instances... {{(pid=117492) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 17:26:45.312769 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b0101d91-9207-4d66-a768-1ab4a47ce494 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 17:26:45.471281 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0ceed553-5442-4a5f-9415-ecc282c393b3 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] 10.222.0.64 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.734122 May 13 17:26:45.477302 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 6/14] 10.222.0.64 () {60 vars in 1161 bytes} [Fri May 13 17:26:44 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:26:45.483218 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b0101d91-9207-4d66-a768-1ab4a47ce494 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.220857 May 13 17:26:45.483896 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 9/15] 10.222.0.64 () {60 vars in 1146 bytes} [Fri May 13 17:26:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 3222 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 17:26:45.484588 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d05c00cd-b94e-4fbf-a847-d84acf6a96f7 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Calling method '.version_select at 0x7fa086a195e0>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:45.499546 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-380011ec-b95a-4fc5-a46f-16df30f15895 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:45.513802 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-380011ec-b95a-4fc5-a46f-16df30f15895 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:26:45.693161 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d05c00cd-b94e-4fbf-a847-d84acf6a96f7 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682" status: 200 len: 286 microversion: 2.1 time: 0.213586 May 13 17:26:45.693906 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 7/16] 10.222.0.64 () {58 vars in 1250 bytes} [Fri May 13 17:26:45 2022] GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682 => generated 286 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:26:45.705914 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d01e8d9e-ce0c-437a-8a81-16768a6c38df tempest-VolumesTestJSON-1603157422 tempest-VolumesTestJSON-1603157422-project] Calling method '.version_select at 0x7fa0869ad790>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:45.909324 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d01e8d9e-ce0c-437a-8a81-16768a6c38df tempest-VolumesTestJSON-1603157422 tempest-VolumesTestJSON-1603157422-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/8e9eea6e-3ac6-49c8-bf02-587a94a8c7af" status: 200 len: 351 microversion: 2.1 time: 0.208977 May 13 17:26:45.910199 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 8/17] 10.222.0.64 () {58 vars in 1244 bytes} [Fri May 13 17:26:45 2022] GET /compute/v2.1/os-volumes/8e9eea6e-3ac6-49c8-bf02-587a94a8c7af => generated 351 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:26:45.915401 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2620aa6f-e690-4592-a56d-86c894deaffd tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Calling method '.version_select at 0x7fa086a194c0>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:46.012761 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2620aa6f-e690-4592-a56d-86c894deaffd tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.101308 May 13 17:26:46.013630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 9/18] 10.222.0.64 () {58 vars in 1139 bytes} [Fri May 13 17:26:45 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:26:46.024624 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f6b95f97-0c0b-4850-8af9-f6629835e6d4 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Calling method '.version_select at 0x7fa0869ada60>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:46.028655 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-380011ec-b95a-4fc5-a46f-16df30f15895 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:26:46.097983 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-380011ec-b95a-4fc5-a46f-16df30f15895 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1215 microversion: 2.1 time: 0.601038 May 13 17:26:46.105393 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 10/19] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:26:45 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1215 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:26:46.311990 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f6b95f97-0c0b-4850-8af9-f6629835e6d4 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682" status: 200 len: 286 microversion: 2.1 time: 0.291021 May 13 17:26:46.313108 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 10/20] 10.222.0.64 () {58 vars in 1250 bytes} [Fri May 13 17:26:46 2022] GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682 => generated 286 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:26:47.248388 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7b8b1d2e-986e-40ef-b2d2-d590a8ec50c6 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:47.248388 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7b8b1d2e-986e-40ef-b2d2-d590a8ec50c6 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:26:47.320560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7b8b1d2e-986e-40ef-b2d2-d590a8ec50c6 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:26:47.326369 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d760b22d-ce6a-46aa-9125-30031cb3ceaf tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Calling method '.version_select at 0x7fa0869ad430>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:47.334884 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7b8b1d2e-986e-40ef-b2d2-d590a8ec50c6 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1215 microversion: 2.1 time: 0.218331 May 13 17:26:47.335552 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 11/21] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:26:47 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1215 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:26:47.410471 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d760b22d-ce6a-46aa-9125-30031cb3ceaf tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682" status: 200 len: 286 microversion: 2.1 time: 0.089820 May 13 17:26:47.414886 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 11/22] 10.222.0.64 () {58 vars in 1250 bytes} [Fri May 13 17:26:47 2022] GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682 => generated 286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:26:48.353994 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-17a47e3a-9ec7-4a2e-8c77-db264b0b0658 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:48.356064 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-17a47e3a-9ec7-4a2e-8c77-db264b0b0658 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:26:48.433926 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0391b76a-1e2c-4c6b-a492-da91b0f48a5b tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Calling method '.version_select at 0x7fa086a19af0>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:48.477075 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0391b76a-1e2c-4c6b-a492-da91b0f48a5b tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682" status: 200 len: 286 microversion: 2.1 time: 0.059089 May 13 17:26:48.478195 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 12/23] 10.222.0.64 () {58 vars in 1250 bytes} [Fri May 13 17:26:48 2022] GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:26:48.589405 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-17a47e3a-9ec7-4a2e-8c77-db264b0b0658 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:26:48.598280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-17a47e3a-9ec7-4a2e-8c77-db264b0b0658 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1215 microversion: 2.1 time: 0.248952 May 13 17:26:48.600037 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 12/24] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:26:48 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1215 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:26:49.493025 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5a1f4d53-a73c-43ca-be86-69a9fa578505 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Calling method '.version_select at 0x7fa086a19d30>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:49.556914 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5a1f4d53-a73c-43ca-be86-69a9fa578505 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682" status: 200 len: 286 microversion: 2.1 time: 0.071605 May 13 17:26:49.557921 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 13/25] 10.222.0.64 () {58 vars in 1250 bytes} [Fri May 13 17:26:49 2022] GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682 => generated 286 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:26:49.615152 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1ff7e8e6-565b-428e-b2a0-00c28da89512 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:49.620689 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-1ff7e8e6-565b-428e-b2a0-00c28da89512 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:26:49.626932 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1ff7e8e6-565b-428e-b2a0-00c28da89512 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:26:49.627414 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1ff7e8e6-565b-428e-b2a0-00c28da89512 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:26:49.628192 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1ff7e8e6-565b-428e-b2a0-00c28da89512 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:26:49.630865 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1ff7e8e6-565b-428e-b2a0-00c28da89512 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:26:49.982297 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-1ff7e8e6-565b-428e-b2a0-00c28da89512 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:26:49.997897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-1ff7e8e6-565b-428e-b2a0-00c28da89512 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1219 microversion: 2.1 time: 0.386510 May 13 17:26:49.998990 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 13/26] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:26:49 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1219 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:26:50.573648 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1244e220-150f-4d5b-b906-f4658248e888 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Calling method '.version_select at 0x7fa08576b160>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:50.641916 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-1244e220-150f-4d5b-b906-f4658248e888 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682" status: 200 len: 286 microversion: 2.1 time: 0.075291 May 13 17:26:50.642769 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 14/27] 10.222.0.64 () {58 vars in 1250 bytes} [Fri May 13 17:26:50 2022] GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682 => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:26:51.016188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-30416d41-79d8-4a36-bbf0-5389a63cc50e tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:51.019084 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-30416d41-79d8-4a36-bbf0-5389a63cc50e tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:26:51.030274 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-30416d41-79d8-4a36-bbf0-5389a63cc50e tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:26:51.030850 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-30416d41-79d8-4a36-bbf0-5389a63cc50e tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:26:51.047548 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-30416d41-79d8-4a36-bbf0-5389a63cc50e tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:26:51.047548 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-30416d41-79d8-4a36-bbf0-5389a63cc50e tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:26:51.069673 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7b8a6d02-f0ab-4834-84b5-6279399a9792 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Action: 'create', calling method: .version_select at 0x7fa086a191f0>, body: {"keypair": {"name": "tempest-keypair-1073404996", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZs9xCtRqc+b9smiv+NVi3M6mSs7PX/RG6pfNsuyr7mtYi9kZ+h+1MKY23L4h121uwWtL01fr6RQ4scnIguriHFQ2OhI4WR1YfsJgJgC6y0vDtexrdYaqzCC17FSXzKrQ=="}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:26:51.169634 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-7b8a6d02-f0ab-4834-84b5-6279399a9792 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Getting quotas for project 6c34f44042ac43cc8a6a7937c0683120. Resources: {'key_pairs'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:26:51.182862 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-7b8a6d02-f0ab-4834-84b5-6279399a9792 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Getting quotas for user 57f36ff6dbd24787baf10788bdf8a1f4 and project 6c34f44042ac43cc8a6a7937c0683120. Resources: {'key_pairs'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:26:51.349702 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-30416d41-79d8-4a36-bbf0-5389a63cc50e tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:26:51.354736 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7b8a6d02-f0ab-4834-84b5-6279399a9792 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.801937 May 13 17:26:51.355365 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 14/28] 10.222.0.64 () {62 vars in 1199 bytes} [Fri May 13 17:26:50 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 803 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) May 13 17:26:51.366214 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-30416d41-79d8-4a36-bbf0-5389a63cc50e tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1219 microversion: 2.1 time: 0.354643 May 13 17:26:51.377565 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 15/29] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:26:51 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1219 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:26:51.654206 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4e00484c-acfa-4d2a-8bf8-d7c9bafa818a tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Calling method '.version_select at 0x7fa0869949d0>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:51.720004 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4e00484c-acfa-4d2a-8bf8-d7c9bafa818a tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682" status: 200 len: 286 microversion: 2.1 time: 0.069838 May 13 17:26:51.720813 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 15/30] 10.222.0.64 () {58 vars in 1250 bytes} [Fri May 13 17:26:51 2022] GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:26:52.385256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-be93ef27-2bce-4494-b531-dda4f7fbdf01 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:52.387528 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-be93ef27-2bce-4494-b531-dda4f7fbdf01 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:26:52.422944 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-be93ef27-2bce-4494-b531-dda4f7fbdf01 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:26:52.424170 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-be93ef27-2bce-4494-b531-dda4f7fbdf01 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:26:52.428293 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-be93ef27-2bce-4494-b531-dda4f7fbdf01 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:26:52.429127 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-be93ef27-2bce-4494-b531-dda4f7fbdf01 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:26:52.637454 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-8df286d5-a334-4565-91d1-8c14cb751c67 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Action: 'create', calling method: .version_select at 0x7fa0857dc790>, body: {"keypair": {"name": "tempest-keypair-639922051", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDjwjJrRuaZIcO3Ck5tlsONi4zcu8wUtM1f+JZWgpEPOiIL7tTQb4VWCYgp6d67zTx9VT4zzVdufjhsmOXkXGOMUR3pqkvTTROoYYkHLaKwu1+XeQtQ5/HRdt0YMNAwDGA=="}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:26:52.685943 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-8df286d5-a334-4565-91d1-8c14cb751c67 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Getting quotas for project ae7b37b41d944427945d783a460ca12a. Resources: {'key_pairs'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:26:52.692833 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-8df286d5-a334-4565-91d1-8c14cb751c67 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Getting quotas for user dfc52b61bcf845d1953a5a111abb3666 and project ae7b37b41d944427945d783a460ca12a. Resources: {'key_pairs'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:26:52.768266 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-be93ef27-2bce-4494-b531-dda4f7fbdf01 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:26:52.786295 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-be93ef27-2bce-4494-b531-dda4f7fbdf01 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1267 microversion: 2.1 time: 0.405510 May 13 17:26:52.797495 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 16/31] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:26:52 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1267 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:26:52.803464 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-04e70200-b1ac-4fab-9e72-638f350f1c92 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Calling method '.version_select at 0x7fa0860684c0>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:52.865974 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-04e70200-b1ac-4fab-9e72-638f350f1c92 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682" status: 200 len: 287 microversion: 2.1 time: 0.066935 May 13 17:26:52.866856 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 17/32] 10.222.0.64 () {58 vars in 1250 bytes} [Fri May 13 17:26:52 2022] GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:26:52.872921 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-8df286d5-a334-4565-91d1-8c14cb751c67 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.584782 May 13 17:26:52.875654 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 16/33] 10.222.0.64 () {60 vars in 1158 bytes} [Fri May 13 17:26:52 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:26:52.882777 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8ff6dcd2-5197-4d4f-858a-b648975f977d tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Calling method '.version_select at 0x7fa08603a280>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:53.055978 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8ff6dcd2-5197-4d4f-858a-b648975f977d tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] 10.222.0.64 "DELETE /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682" status: 202 len: 0 microversion: 2.1 time: 0.177512 May 13 17:26:53.056563 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 18/34] 10.222.0.64 () {58 vars in 1253 bytes} [Fri May 13 17:26:52 2022] DELETE /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:26:53.066627 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-72aede45-3f8d-4ce6-9533-4733932eaaa0 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Calling method '.version_select at 0x7fa08577c0d0>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:53.133269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-72aede45-3f8d-4ce6-9533-4733932eaaa0 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682" status: 200 len: 286 microversion: 2.1 time: 0.072188 May 13 17:26:53.133989 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 17/35] 10.222.0.64 () {58 vars in 1250 bytes} [Fri May 13 17:26:53 2022] GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682 => generated 286 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:26:53.805719 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4d08a43d-185f-4c56-8f7a-76e25ca7d474 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:53.810280 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4d08a43d-185f-4c56-8f7a-76e25ca7d474 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:26:53.822678 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d08a43d-185f-4c56-8f7a-76e25ca7d474 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:26:53.825673 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d08a43d-185f-4c56-8f7a-76e25ca7d474 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:26:53.831432 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d08a43d-185f-4c56-8f7a-76e25ca7d474 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:26:53.832783 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d08a43d-185f-4c56-8f7a-76e25ca7d474 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:26:53.949541 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d9ebc996-f130-4ef2-9b6c-ceea759621a2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Action: 'create', calling method: .version_select at 0x7fa085720ee0>, body: {"keypair": {"name": "tempest-keypair-1645480836", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK20PhpzHSgBLC2ki2eiwTkeknqIhuCWSddYcg64Xlvp5XEsRjo3QM9Okr90L6atHBd48VTxtMBuUO+5F6ArwvP6vW38ly88lS5SjLJDLarlxCcIHGSh6bCGhtYJfophfg=="}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:26:53.987878 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-d9ebc996-f130-4ef2-9b6c-ceea759621a2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Getting quotas for project f8e7b818f3a74fc48f0faeeb3398069a. Resources: {'key_pairs'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:26:53.997163 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-d9ebc996-f130-4ef2-9b6c-ceea759621a2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Getting quotas for user efc23cbdbebc423baed1a2cb6c6cd7e7 and project f8e7b818f3a74fc48f0faeeb3398069a. Resources: {'key_pairs'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:26:54.105669 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d9ebc996-f130-4ef2-9b6c-ceea759621a2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.237668 May 13 17:26:54.114301 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4d08a43d-185f-4c56-8f7a-76e25ca7d474 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:26:54.116635 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 18/36] 10.222.0.64 () {60 vars in 1158 bytes} [Fri May 13 17:26:53 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:26:54.132083 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4d08a43d-185f-4c56-8f7a-76e25ca7d474 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1267 microversion: 2.1 time: 0.331297 May 13 17:26:54.132687 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 19/37] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:26:53 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1267 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:26:54.147367 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f79e5bc6-a27a-411d-9a57-d72e44477be8 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Calling method '.version_select at 0x7fa085720310>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:54.223497 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f79e5bc6-a27a-411d-9a57-d72e44477be8 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682" status: 200 len: 286 microversion: 2.1 time: 0.081309 May 13 17:26:54.229954 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 19/38] 10.222.0.64 () {58 vars in 1250 bytes} [Fri May 13 17:26:54 2022] GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682 => generated 286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:26:55.149683 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3f601385-eb6a-4321-9f29-3d54d8e84434 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:55.150715 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3f601385-eb6a-4321-9f29-3d54d8e84434 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:26:55.159479 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3f601385-eb6a-4321-9f29-3d54d8e84434 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:26:55.165630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3f601385-eb6a-4321-9f29-3d54d8e84434 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:26:55.166533 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3f601385-eb6a-4321-9f29-3d54d8e84434 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:26:55.166991 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3f601385-eb6a-4321-9f29-3d54d8e84434 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:26:55.238421 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6446e10d-33a9-4c9b-a25e-2aef1f7bbe6e tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Calling method '.version_select at 0x7fa08576b280>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:55.298552 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3f601385-eb6a-4321-9f29-3d54d8e84434 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:26:55.302931 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6446e10d-33a9-4c9b-a25e-2aef1f7bbe6e tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682" status: 200 len: 286 microversion: 2.1 time: 0.069395 May 13 17:26:55.303260 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 20/39] 10.222.0.64 () {58 vars in 1250 bytes} [Fri May 13 17:26:55 2022] GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682 => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:26:55.309896 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3f601385-eb6a-4321-9f29-3d54d8e84434 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1267 microversion: 2.1 time: 0.161879 May 13 17:26:55.313320 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 20/40] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:26:55 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1267 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:26:56.223101 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-170e3544-a79d-44d3-a41d-dfaef5a9e3c3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1795784224", "imageRef": "7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42afb35d-ebab-4abb-a123-24b9a2b301c2"}], "security_groups": [{"name": "tempest-securitygroup--239763934"}], "key_name": "tempest-keypair-1073404996", "user_data": "}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:26:56.319995 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-cdb9105b-cb25-4003-82bc-a3e93889fa38 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Calling method '.version_select at 0x7fa0860469d0>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:56.443368 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-cdb9105b-cb25-4003-82bc-a3e93889fa38 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682" status: 200 len: 286 microversion: 2.1 time: 0.128852 May 13 17:26:56.444464 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 21/41] 10.222.0.64 () {58 vars in 1250 bytes} [Fri May 13 17:26:56 2022] GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682 => generated 286 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:26:56.458450 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-131a3727-3acf-4d7b-8d6a-e226936fbde5 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:56.458450 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-131a3727-3acf-4d7b-8d6a-e226936fbde5 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:26:56.474745 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-131a3727-3acf-4d7b-8d6a-e226936fbde5 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:26:56.481830 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-131a3727-3acf-4d7b-8d6a-e226936fbde5 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:26:56.499210 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-131a3727-3acf-4d7b-8d6a-e226936fbde5 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:26:56.499210 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-131a3727-3acf-4d7b-8d6a-e226936fbde5 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:26:56.516290 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.network.neutron [None req-170e3544-a79d-44d3-a41d-dfaef5a9e3c3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] validate_networks() for [('42afb35d-ebab-4abb-a123-24b9a2b301c2', None, None, None, None, None)] {{(pid=117492) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 17:26:56.779435 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-131a3727-3acf-4d7b-8d6a-e226936fbde5 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:26:56.794675 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-131a3727-3acf-4d7b-8d6a-e226936fbde5 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1275 microversion: 2.1 time: 0.349023 May 13 17:26:56.803795 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 22/42] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:26:56 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1275 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:26:57.457131 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-36ac6ad1-24ca-41d4-8e45-ed88d02cf74c tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Calling method '.version_select at 0x7fa0860469d0>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:57.506114 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-36ac6ad1-24ca-41d4-8e45-ed88d02cf74c tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] HTTP exception thrown: Snapshot 4d94687c-e961-4170-a4f1-91a613356682 could not be found. May 13 17:26:57.513594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-36ac6ad1-24ca-41d4-8e45-ed88d02cf74c tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Request method failure captured: May 13 17:26:57.513594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682 HTTP/1.1 May 13 17:26:57.513594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:26:57.513594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:26:57.513594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:26:57.513594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:26:57.513594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:26:57.513594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:26:57.513594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:26:57.513594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:26:57.513594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpTP-LhMDJfOVhSGh0RzrFgBzsr687zHxcmuPf0mG7xCsPgBqC-R4cxhh3jz6h3gLa4I--fG0hSAeapGZgfUckZtu-HdpVPUdxp8wao6uOU_oBiKtU-m2_08CJmaRL33aAaVe4oOKRrrCK8047oVHfVtbi9zGUVXlFngeMlYwANihmo May 13 17:26:57.513594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:26:57.513594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:26:57.513594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:26:57.513594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:26:57.513594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:26:57.513594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:26:57.513594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: f2ad6b80d4e64431aea1f48de4aa5548 May 13 17:26:57.513594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-616382160 May 13 17:26:57.513594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:26:57.513594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:26:57.515446 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f2ad6b80d4e64431aea1f48de4aa5548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f2ad6b80d4e64431aea1f48de4aa5548"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f2ad6b80d4e64431aea1f48de4aa5548"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f2ad6b80d4e64431aea1f48de4aa5548"}]}] May 13 17:26:57.515446 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-VolumesSnapshotsTestJSON-616382160 May 13 17:26:57.515446 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: f2ad6b80d4e64431aea1f48de4aa5548 May 13 17:26:57.515446 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-616382160 May 13 17:26:57.515446 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-VolumesSnapshotsTestJSON-616382160-project May 13 17:26:57.515446 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:26:57.515446 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:26:57.515446 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: 5ceb047e6d0b46279f54e507fd53b7f9 May 13 17:26:57.515446 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-VolumesSnapshotsTestJSON-616382160-project May 13 17:26:57.515446 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: May 13 17:26:57.515446 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Snapshot 4d94687c-e961-4170-a4f1-91a613356682 could not be found. May 13 17:26:57.515446 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '4d94687c-e961-4170-a4f1-91a613356682'} May 13 17:26:57.515446 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:26:57.516276 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:26:57.516276 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 13 17:26:57.516276 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 13 17:26:57.516276 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 13 17:26:57.516276 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 13 17:26:57.516276 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 13 17:26:57.516276 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 13 17:26:57.516276 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 17:26:57.516276 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 17:26:57.516276 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 17:26:57.516276 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 17:26:57.516276 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 17:26:57.516276 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 17:26:57.516276 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 17:26:57.516276 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 17:26:57.516276 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 4d94687c-e961-4170-a4f1-91a613356682 could not be found. (HTTP 404) (Request-ID: req-e9ca745a-9895-4e28-8a48-a9cd92be2770) May 13 17:26:57.516276 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:26:57.516276 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:26:57.517224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:26:57.517224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:26:57.517224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 13 17:26:57.517224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 13 17:26:57.517224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 17:26:57.517224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 17:26:57.517224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 13 17:26:57.517224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 13 17:26:57.517224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 17:26:57.517224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 17:26:57.517224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 13 17:26:57.517224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 13 17:26:57.517224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 13 17:26:57.517224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 13 17:26:57.517224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 13 17:26:57.517224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 13 17:26:57.517224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 17:26:57.517224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 17:26:57.517224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 17:26:57.518481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 17:26:57.518481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 17:26:57.518481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 17:26:57.518481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 17:26:57.518481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 17:26:57.518481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 4d94687c-e961-4170-a4f1-91a613356682 could not be found. May 13 17:26:57.518481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:26:57.518481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:26:57.518481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:26:57.518481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:26:57.518481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:26:57.518481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:26:57.518481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:26:57.518481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:26:57.518481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 17:26:57.518481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 17:26:57.518481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:26:57.518481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:26:57.518481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 13 17:26:57.518481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:26:57.519901 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 4d94687c-e961-4170-a4f1-91a613356682 could not be found. May 13 17:26:57.519901 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:26:57.519901 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:26:57.519901 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:26:57.519901 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:26:57.519901 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:26:57.519901 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:26:57.519901 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:26:57.519901 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:26:57.519901 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 4d94687c-e961-4170-a4f1-91a613356682 could not be found. May 13 17:26:57.519901 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:26:57.519901 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-36ac6ad1-24ca-41d4-8e45-ed88d02cf74c tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Returning 404 to user: Snapshot 4d94687c-e961-4170-a4f1-91a613356682 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:26:57.519901 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-36ac6ad1-24ca-41d4-8e45-ed88d02cf74c tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682" status: 404 len: 111 microversion: 2.1 time: 0.063819 May 13 17:26:57.520927 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 23/43] 10.222.0.64 () {58 vars in 1250 bytes} [Fri May 13 17:26:57 2022] GET /compute/v2.1/os-snapshots/4d94687c-e961-4170-a4f1-91a613356682 => generated 111 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:26:57.546866 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7b7ca5f3-6a9e-49af-8e57-89a4348f6f0e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1262044089", "imageRef": "7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88108179-f685-4c21-8286-b31593459871"}], "security_groups": [{"name": "tempest-securitygroup--650457714"}], "key_name": "tempest-keypair-639922051", "user_data": "}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:26:58.136414 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-170e3544-a79d-44d3-a41d-dfaef5a9e3c3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Flavor limits 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 17:26:58.138665 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-170e3544-a79d-44d3-a41d-dfaef5a9e3c3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Image limits 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 17:26:58.139540 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-170e3544-a79d-44d3-a41d-dfaef5a9e3c3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Flavor pref 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 17:26:58.140706 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-170e3544-a79d-44d3-a41d-dfaef5a9e3c3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Image pref 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 17:26:58.141402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-170e3544-a79d-44d3-a41d-dfaef5a9e3c3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 17:26:58.159082 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-170e3544-a79d-44d3-a41d-dfaef5a9e3c3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:26:58.161237 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-170e3544-a79d-44d3-a41d-dfaef5a9e3c3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:26:58.162425 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-170e3544-a79d-44d3-a41d-dfaef5a9e3c3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:26:58.163747 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-170e3544-a79d-44d3-a41d-dfaef5a9e3c3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:26:58.273440 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-170e3544-a79d-44d3-a41d-dfaef5a9e3c3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Getting quotas for project 6c34f44042ac43cc8a6a7937c0683120. Resources: {'ram', 'instances', 'cores'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:26:58.283485 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-170e3544-a79d-44d3-a41d-dfaef5a9e3c3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Getting quotas for user 57f36ff6dbd24787baf10788bdf8a1f4 and project 6c34f44042ac43cc8a6a7937c0683120. Resources: {'ram', 'instances', 'cores'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:26:58.291482 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.network.neutron [None req-7b7ca5f3-6a9e-49af-8e57-89a4348f6f0e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] validate_networks() for [('88108179-f685-4c21-8286-b31593459871', None, None, None, None, None)] {{(pid=117493) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 17:26:58.316420 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-170e3544-a79d-44d3-a41d-dfaef5a9e3c3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Going to run 1 instances... {{(pid=117492) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 17:26:58.330323 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-170e3544-a79d-44d3-a41d-dfaef5a9e3c3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 17:26:58.498716 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-170e3544-a79d-44d3-a41d-dfaef5a9e3c3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.279914 May 13 17:26:58.514385 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 21/44] 10.222.0.64 () {62 vars in 1187 bytes} [Fri May 13 17:26:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 2293 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 13 17:26:58.520792 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-8c67654c-bd5c-435f-9532-1009fe11ae0f tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Calling method '.version_select at 0x7fa08572a5e0>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:58.914531 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-8c67654c-bd5c-435f-9532-1009fe11ae0f tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/3ea00bea-a861-4ffa-9437-6d5e26d6c152" status: 202 len: 0 microversion: 2.1 time: 0.395100 May 13 17:26:58.915631 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 22/45] 10.222.0.64 () {58 vars in 1247 bytes} [Fri May 13 17:26:58 2022] DELETE /compute/v2.1/os-volumes/3ea00bea-a861-4ffa-9437-6d5e26d6c152 => generated 0 bytes in 401 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:26:58.921960 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-182929fa-4c70-493f-96ba-c7aaa4859363 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:58.923837 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-182929fa-4c70-493f-96ba-c7aaa4859363 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:26:58.946901 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-182929fa-4c70-493f-96ba-c7aaa4859363 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:26:58.947980 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-182929fa-4c70-493f-96ba-c7aaa4859363 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:26:58.950287 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-182929fa-4c70-493f-96ba-c7aaa4859363 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:26:58.952161 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-182929fa-4c70-493f-96ba-c7aaa4859363 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:26:59.138258 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-182929fa-4c70-493f-96ba-c7aaa4859363 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:26:59.152858 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-182929fa-4c70-493f-96ba-c7aaa4859363 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1273 microversion: 2.1 time: 0.234998 May 13 17:26:59.154978 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 23/46] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:26:58 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1273 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:26:59.206224 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-755a3836-2ae1-44f5-a790-d91ec03e76af tempest-VolumesTestJSON-1603157422 tempest-VolumesTestJSON-1603157422-project] Calling method '.version_select at 0x7fa08574cd30>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:59.409748 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-755a3836-2ae1-44f5-a790-d91ec03e76af tempest-VolumesTestJSON-1603157422 tempest-VolumesTestJSON-1603157422-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/9f8b118f-b04f-4eb0-850f-04b40066a8bb" status: 200 len: 349 microversion: 2.1 time: 0.228692 May 13 17:26:59.411360 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 24/47] 10.222.0.64 () {58 vars in 1244 bytes} [Fri May 13 17:26:59 2022] GET /compute/v2.1/os-volumes/9f8b118f-b04f-4eb0-850f-04b40066a8bb => generated 349 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:26:59.425770 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-2f4ac483-c0ce-4b7d-ac96-c216d608f0f4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:26:59.427331 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-2f4ac483-c0ce-4b7d-ac96-c216d608f0f4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:26:59.686733 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-2f4ac483-c0ce-4b7d-ac96-c216d608f0f4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:26:59.696458 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-2f4ac483-c0ce-4b7d-ac96-c216d608f0f4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:26:59.697975 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-2f4ac483-c0ce-4b7d-ac96-c216d608f0f4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:26:59.716863 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-2f4ac483-c0ce-4b7d-ac96-c216d608f0f4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1282 microversion: 2.20 time: 0.303781 May 13 17:26:59.724937 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 25/48] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:26:59 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1282 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:26:59.746887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-29c5a4a5-17d6-4323-b10a-a4501aa7c99a tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Calling method '.version_select at 0x7fa08574cb80>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:00.014469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-29c5a4a5-17d6-4323-b10a-a4501aa7c99a tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] HTTP exception thrown: Volume 3ea00bea-a861-4ffa-9437-6d5e26d6c152 could not be found. May 13 17:27:00.014469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-29c5a4a5-17d6-4323-b10a-a4501aa7c99a tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Request method failure captured: May 13 17:27:00.014469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: GET /compute/v2.1/os-volumes/3ea00bea-a861-4ffa-9437-6d5e26d6c152 HTTP/1.1 May 13 17:27:00.014469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:27:00.014469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:27:00.014469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:27:00.014469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 0 May 13 17:27:00.014469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:27:00.014469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:27:00.014469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:27:00.014469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:27:00.014469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpTP-LhMDJfOVhSGh0RzrFgBzsr687zHxcmuPf0mG7xCsPgBqC-R4cxhh3jz6h3gLa4I--fG0hSAeapGZgfUckZtu-HdpVPUdxp8wao6uOU_oBiKtU-m2_08CJmaRL33aAaVe4oOKRrrCK8047oVHfVtbi9zGUVXlFngeMlYwANihmo May 13 17:27:00.014469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:27:00.014469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:27:00.014469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:27:00.014469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:27:00.014469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:27:00.014469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:27:00.014469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: f2ad6b80d4e64431aea1f48de4aa5548 May 13 17:27:00.014469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-616382160 May 13 17:27:00.014469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:27:00.014469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:27:00.018139 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f2ad6b80d4e64431aea1f48de4aa5548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f2ad6b80d4e64431aea1f48de4aa5548"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f2ad6b80d4e64431aea1f48de4aa5548"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f2ad6b80d4e64431aea1f48de4aa5548"}]}] May 13 17:27:00.018139 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-VolumesSnapshotsTestJSON-616382160 May 13 17:27:00.018139 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: f2ad6b80d4e64431aea1f48de4aa5548 May 13 17:27:00.018139 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-616382160 May 13 17:27:00.018139 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-VolumesSnapshotsTestJSON-616382160-project May 13 17:27:00.018139 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:27:00.018139 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:27:00.018139 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: 5ceb047e6d0b46279f54e507fd53b7f9 May 13 17:27:00.018139 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-VolumesSnapshotsTestJSON-616382160-project May 13 17:27:00.018139 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: May 13 17:27:00.018139 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Volume 3ea00bea-a861-4ffa-9437-6d5e26d6c152 could not be found. May 13 17:27:00.018139 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'id': '3ea00bea-a861-4ffa-9437-6d5e26d6c152'} May 13 17:27:00.018139 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:27:00.020306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:27:00.020306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 17:27:00.020306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 17:27:00.020306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 17:27:00.020306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 17:27:00.020306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 17:27:00.020306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 17:27:00.020306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 17:27:00.020306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 17:27:00.020306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 17:27:00.020306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 17:27:00.020306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 17:27:00.020306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 17:27:00.020306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 17:27:00.020306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 17:27:00.020306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3ea00bea-a861-4ffa-9437-6d5e26d6c152 could not be found. (HTTP 404) (Request-ID: req-1d1d5395-6cf6-4978-be7d-66732a56d8ab) May 13 17:27:00.020306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:27:00.020306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:27:00.020306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:27:00.022074 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:27:00.022074 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 17:27:00.022074 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 17:27:00.022074 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 17:27:00.022074 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 17:27:00.022074 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 17:27:00.022074 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 17:27:00.022074 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 17:27:00.022074 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 17:27:00.022074 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 17:27:00.022074 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 17:27:00.022074 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 17:27:00.022074 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 17:27:00.022074 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 17:27:00.022074 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 17:27:00.022074 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 17:27:00.022074 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 17:27:00.022074 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 17:27:00.022074 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 17:27:00.027238 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 17:27:00.027238 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 17:27:00.027238 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 17:27:00.027238 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 17:27:00.027238 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3ea00bea-a861-4ffa-9437-6d5e26d6c152 could not be found. May 13 17:27:00.027238 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:27:00.027238 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:27:00.027238 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:27:00.027238 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:27:00.027238 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:27:00.027238 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:27:00.027238 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:27:00.027238 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:27:00.027238 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 17:27:00.027238 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 17:27:00.027238 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:27:00.027238 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:27:00.027238 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 17:27:00.027238 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:27:00.028681 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3ea00bea-a861-4ffa-9437-6d5e26d6c152 could not be found. May 13 17:27:00.028681 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:27:00.028681 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:27:00.028681 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:27:00.028681 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:27:00.028681 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:27:00.028681 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:27:00.028681 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:27:00.028681 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:27:00.028681 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3ea00bea-a861-4ffa-9437-6d5e26d6c152 could not be found. May 13 17:27:00.028681 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:27:00.028681 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-29c5a4a5-17d6-4323-b10a-a4501aa7c99a tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Returning 404 to user: Volume 3ea00bea-a861-4ffa-9437-6d5e26d6c152 could not be found. {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:27:00.028681 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-29c5a4a5-17d6-4323-b10a-a4501aa7c99a tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/3ea00bea-a861-4ffa-9437-6d5e26d6c152" status: 404 len: 109 microversion: 2.1 time: 0.143845 May 13 17:27:00.028681 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 26/49] 10.222.0.64 () {58 vars in 1244 bytes} [Fri May 13 17:26:59 2022] GET /compute/v2.1/os-volumes/3ea00bea-a861-4ffa-9437-6d5e26d6c152 => generated 109 bytes in 150 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:27:00.029605 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6b9b49de-665b-4dad-9c1b-dd36203b8d74 tempest-VolumesTestJSON-1603157422 tempest-VolumesTestJSON-1603157422-project] Calling method '.version_select at 0x7fa08574cf70>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:00.072594 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6b9b49de-665b-4dad-9c1b-dd36203b8d74 tempest-VolumesTestJSON-1603157422 tempest-VolumesTestJSON-1603157422-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.196132 May 13 17:27:00.073175 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 27/50] 10.222.0.64 () {58 vars in 1133 bytes} [Fri May 13 17:26:59 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:00.080583 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1b0b452a-c1bf-43ab-a51f-d45d683f501b tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Calling method '.version_select at 0x7fa08604b550>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:00.111366 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-1b0b452a-c1bf-43ab-a51f-d45d683f501b tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] HTTP exception thrown: Volume 3ea00bea-a861-4ffa-9437-6d5e26d6c152 could not be found. May 13 17:27:00.113569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1b0b452a-c1bf-43ab-a51f-d45d683f501b tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Request method failure captured: May 13 17:27:00.113569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: DELETE /compute/v2.1/os-volumes/3ea00bea-a861-4ffa-9437-6d5e26d6c152 HTTP/1.1 May 13 17:27:00.113569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:27:00.113569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:27:00.113569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:27:00.113569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 0 May 13 17:27:00.113569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:27:00.113569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:27:00.113569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:27:00.113569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:27:00.113569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpTP-LhMDJfOVhSGh0RzrFgBzsr687zHxcmuPf0mG7xCsPgBqC-R4cxhh3jz6h3gLa4I--fG0hSAeapGZgfUckZtu-HdpVPUdxp8wao6uOU_oBiKtU-m2_08CJmaRL33aAaVe4oOKRrrCK8047oVHfVtbi9zGUVXlFngeMlYwANihmo May 13 17:27:00.113569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:27:00.113569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:27:00.113569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:27:00.113569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:27:00.113569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:27:00.113569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:27:00.113569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: f2ad6b80d4e64431aea1f48de4aa5548 May 13 17:27:00.113569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-616382160 May 13 17:27:00.113569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:27:00.113569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:27:00.114802 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f2ad6b80d4e64431aea1f48de4aa5548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f2ad6b80d4e64431aea1f48de4aa5548"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f2ad6b80d4e64431aea1f48de4aa5548"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f2ad6b80d4e64431aea1f48de4aa5548"}]}] May 13 17:27:00.114802 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-VolumesSnapshotsTestJSON-616382160 May 13 17:27:00.114802 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: f2ad6b80d4e64431aea1f48de4aa5548 May 13 17:27:00.114802 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-616382160 May 13 17:27:00.114802 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-VolumesSnapshotsTestJSON-616382160-project May 13 17:27:00.114802 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:27:00.114802 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:27:00.114802 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: 5ceb047e6d0b46279f54e507fd53b7f9 May 13 17:27:00.114802 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-VolumesSnapshotsTestJSON-616382160-project May 13 17:27:00.114802 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: May 13 17:27:00.114802 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Volume 3ea00bea-a861-4ffa-9437-6d5e26d6c152 could not be found. May 13 17:27:00.114802 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'id': '3ea00bea-a861-4ffa-9437-6d5e26d6c152'} May 13 17:27:00.114802 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:27:00.115525 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:27:00.115525 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 17:27:00.115525 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 17:27:00.115525 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 17:27:00.115525 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 17:27:00.115525 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 17:27:00.115525 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 17:27:00.115525 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 17:27:00.115525 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 17:27:00.115525 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 17:27:00.115525 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 17:27:00.115525 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 17:27:00.115525 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 17:27:00.115525 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 17:27:00.115525 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 17:27:00.115525 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3ea00bea-a861-4ffa-9437-6d5e26d6c152 could not be found. (HTTP 404) (Request-ID: req-e50fa290-f18a-4d9b-b9df-f3f792215fe6) May 13 17:27:00.115525 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:27:00.115525 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:27:00.115525 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:27:00.116668 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:27:00.116668 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 13 17:27:00.116668 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 13 17:27:00.116668 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 17:27:00.116668 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 17:27:00.116668 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 17:27:00.116668 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 17:27:00.116668 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 17:27:00.116668 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 17:27:00.116668 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 17:27:00.116668 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 17:27:00.116668 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 13 17:27:00.116668 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 13 17:27:00.116668 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 13 17:27:00.116668 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 13 17:27:00.116668 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 13 17:27:00.116668 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 13 17:27:00.116668 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 13 17:27:00.116668 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 13 17:27:00.117778 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 17:27:00.117778 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 17:27:00.117778 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 17:27:00.117778 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 17:27:00.117778 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3ea00bea-a861-4ffa-9437-6d5e26d6c152 could not be found. May 13 17:27:00.117778 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:27:00.117778 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:27:00.117778 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:27:00.117778 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:27:00.117778 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:27:00.117778 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:27:00.117778 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:27:00.117778 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:27:00.117778 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 17:27:00.117778 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 17:27:00.117778 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:27:00.117778 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:27:00.117778 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 13 17:27:00.117778 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:27:00.118850 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3ea00bea-a861-4ffa-9437-6d5e26d6c152 could not be found. May 13 17:27:00.118850 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:27:00.118850 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:27:00.118850 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:27:00.118850 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:27:00.118850 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:27:00.118850 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:27:00.118850 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:27:00.118850 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:27:00.118850 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3ea00bea-a861-4ffa-9437-6d5e26d6c152 could not be found. May 13 17:27:00.118850 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:27:00.120441 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1b0b452a-c1bf-43ab-a51f-d45d683f501b tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Returning 404 to user: Volume 3ea00bea-a861-4ffa-9437-6d5e26d6c152 could not be found. {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:27:00.121372 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-1b0b452a-c1bf-43ab-a51f-d45d683f501b tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/3ea00bea-a861-4ffa-9437-6d5e26d6c152" status: 404 len: 109 microversion: 2.1 time: 0.046912 May 13 17:27:00.121921 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 28/51] 10.222.0.64 () {58 vars in 1247 bytes} [Fri May 13 17:27:00 2022] DELETE /compute/v2.1/os-volumes/3ea00bea-a861-4ffa-9437-6d5e26d6c152 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:27:00.127842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-44e34de1-eff5-41d9-8444-cf00425d875b tempest-VolumesTestJSON-1603157422 tempest-VolumesTestJSON-1603157422-project] Calling method '.version_select at 0x7fa08574caf0>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:00.224508 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-44e34de1-eff5-41d9-8444-cf00425d875b tempest-VolumesTestJSON-1603157422 tempest-VolumesTestJSON-1603157422-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.101226 May 13 17:27:00.235228 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 29/52] 10.222.0.64 () {58 vars in 1148 bytes} [Fri May 13 17:27:00 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:27:00.242428 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-93062c92-10b5-409b-b0d3-70a6614c23f6 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Calling method '.version_select at 0x7fa08574c3a0>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:00.279398 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-93062c92-10b5-409b-b0d3-70a6614c23f6 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] HTTP exception thrown: Volume 3ea00bea-a861-4ffa-9437-6d5e26d6c152 could not be found. May 13 17:27:00.283701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-93062c92-10b5-409b-b0d3-70a6614c23f6 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Request method failure captured: May 13 17:27:00.283701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: GET /compute/v2.1/os-volumes/3ea00bea-a861-4ffa-9437-6d5e26d6c152 HTTP/1.1 May 13 17:27:00.283701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:27:00.283701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:27:00.283701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:27:00.283701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 0 May 13 17:27:00.283701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:27:00.283701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:27:00.283701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:27:00.283701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:27:00.283701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpTP-LhMDJfOVhSGh0RzrFgBzsr687zHxcmuPf0mG7xCsPgBqC-R4cxhh3jz6h3gLa4I--fG0hSAeapGZgfUckZtu-HdpVPUdxp8wao6uOU_oBiKtU-m2_08CJmaRL33aAaVe4oOKRrrCK8047oVHfVtbi9zGUVXlFngeMlYwANihmo May 13 17:27:00.283701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:27:00.283701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:27:00.283701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:27:00.283701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:27:00.283701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:27:00.283701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:27:00.283701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: f2ad6b80d4e64431aea1f48de4aa5548 May 13 17:27:00.283701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-616382160 May 13 17:27:00.283701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:27:00.283701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:27:00.285054 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f2ad6b80d4e64431aea1f48de4aa5548"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f2ad6b80d4e64431aea1f48de4aa5548"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f2ad6b80d4e64431aea1f48de4aa5548"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f2ad6b80d4e64431aea1f48de4aa5548"}]}] May 13 17:27:00.285054 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-VolumesSnapshotsTestJSON-616382160 May 13 17:27:00.285054 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: f2ad6b80d4e64431aea1f48de4aa5548 May 13 17:27:00.285054 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-616382160 May 13 17:27:00.285054 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-VolumesSnapshotsTestJSON-616382160-project May 13 17:27:00.285054 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:27:00.285054 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:27:00.285054 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: 5ceb047e6d0b46279f54e507fd53b7f9 May 13 17:27:00.285054 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-VolumesSnapshotsTestJSON-616382160-project May 13 17:27:00.285054 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: May 13 17:27:00.285054 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Volume 3ea00bea-a861-4ffa-9437-6d5e26d6c152 could not be found. May 13 17:27:00.285054 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'id': '3ea00bea-a861-4ffa-9437-6d5e26d6c152'} May 13 17:27:00.285054 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:27:00.285892 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:27:00.285892 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 17:27:00.285892 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 17:27:00.285892 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 17:27:00.285892 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 17:27:00.285892 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 17:27:00.285892 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 17:27:00.285892 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 17:27:00.285892 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 17:27:00.285892 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 17:27:00.285892 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 17:27:00.285892 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 17:27:00.285892 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 17:27:00.285892 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 17:27:00.285892 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 17:27:00.285892 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3ea00bea-a861-4ffa-9437-6d5e26d6c152 could not be found. (HTTP 404) (Request-ID: req-2bde3016-0f31-42fa-9d51-b7edec1285e8) May 13 17:27:00.285892 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:27:00.285892 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:27:00.285892 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:27:00.287111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:27:00.287111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 17:27:00.287111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 17:27:00.287111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 17:27:00.287111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 17:27:00.287111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 17:27:00.287111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 17:27:00.287111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 17:27:00.287111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 17:27:00.287111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 17:27:00.287111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 17:27:00.287111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 17:27:00.287111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 17:27:00.287111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 17:27:00.287111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 17:27:00.287111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 17:27:00.287111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 17:27:00.287111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 17:27:00.287111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 17:27:00.288273 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 17:27:00.288273 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 17:27:00.288273 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 17:27:00.288273 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 17:27:00.288273 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3ea00bea-a861-4ffa-9437-6d5e26d6c152 could not be found. May 13 17:27:00.288273 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:27:00.288273 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:27:00.288273 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:27:00.288273 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:27:00.288273 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:27:00.288273 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:27:00.288273 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:27:00.288273 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:27:00.288273 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 17:27:00.288273 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 17:27:00.288273 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:27:00.288273 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:27:00.288273 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 17:27:00.288273 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:27:00.289402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3ea00bea-a861-4ffa-9437-6d5e26d6c152 could not be found. May 13 17:27:00.289402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:27:00.289402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:27:00.289402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:27:00.289402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:27:00.289402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:27:00.289402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:27:00.289402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:27:00.289402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:27:00.289402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3ea00bea-a861-4ffa-9437-6d5e26d6c152 could not be found. May 13 17:27:00.289402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:27:00.290996 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-93062c92-10b5-409b-b0d3-70a6614c23f6 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] Returning 404 to user: Volume 3ea00bea-a861-4ffa-9437-6d5e26d6c152 could not be found. {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:27:00.292025 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-93062c92-10b5-409b-b0d3-70a6614c23f6 tempest-VolumesSnapshotsTestJSON-616382160 tempest-VolumesSnapshotsTestJSON-616382160-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/3ea00bea-a861-4ffa-9437-6d5e26d6c152" status: 404 len: 109 microversion: 2.1 time: 0.055586 May 13 17:27:00.292570 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-7b7ca5f3-6a9e-49af-8e57-89a4348f6f0e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Flavor limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 17:27:00.293056 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-7b7ca5f3-6a9e-49af-8e57-89a4348f6f0e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Image limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 17:27:00.293369 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 30/53] 10.222.0.64 () {58 vars in 1244 bytes} [Fri May 13 17:27:00 2022] GET /compute/v2.1/os-volumes/3ea00bea-a861-4ffa-9437-6d5e26d6c152 => generated 109 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:27:00.293648 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-7b7ca5f3-6a9e-49af-8e57-89a4348f6f0e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Flavor pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 17:27:00.294146 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-7b7ca5f3-6a9e-49af-8e57-89a4348f6f0e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Image pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 17:27:00.294623 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-7b7ca5f3-6a9e-49af-8e57-89a4348f6f0e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 17:27:00.299361 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-2b1bd0b6-e3c5-4158-a668-2a0674da5c55 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:00.300229 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-2b1bd0b6-e3c5-4158-a668-2a0674da5c55 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:00.312369 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2b1bd0b6-e3c5-4158-a668-2a0674da5c55 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:00.313884 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2b1bd0b6-e3c5-4158-a668-2a0674da5c55 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:00.315751 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2b1bd0b6-e3c5-4158-a668-2a0674da5c55 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:00.316538 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2b1bd0b6-e3c5-4158-a668-2a0674da5c55 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:00.325264 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7b7ca5f3-6a9e-49af-8e57-89a4348f6f0e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:00.327580 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7b7ca5f3-6a9e-49af-8e57-89a4348f6f0e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:00.330767 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7b7ca5f3-6a9e-49af-8e57-89a4348f6f0e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:00.332603 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7b7ca5f3-6a9e-49af-8e57-89a4348f6f0e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:00.444778 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-7b7ca5f3-6a9e-49af-8e57-89a4348f6f0e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Getting quotas for project ae7b37b41d944427945d783a460ca12a. Resources: {'ram', 'instances', 'cores'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:27:00.458152 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-7b7ca5f3-6a9e-49af-8e57-89a4348f6f0e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Getting quotas for user dfc52b61bcf845d1953a5a111abb3666 and project ae7b37b41d944427945d783a460ca12a. Resources: {'ram', 'instances', 'cores'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:27:00.475972 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7b7ca5f3-6a9e-49af-8e57-89a4348f6f0e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Going to run 1 instances... {{(pid=117493) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 17:27:00.489931 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7b7ca5f3-6a9e-49af-8e57-89a4348f6f0e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 17:27:00.713363 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7b7ca5f3-6a9e-49af-8e57-89a4348f6f0e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.188236 May 13 17:27:00.713363 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 24/54] 10.222.0.64 () {60 vars in 1146 bytes} [Fri May 13 17:26:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 3191 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 17:27:00.737763 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-109b18f8-911c-48a4-876e-3098ec6aef7f tempest-VolumesTestJSON-1603157422 tempest-VolumesTestJSON-1603157422-project] Calling method '.version_select at 0x7fa085f1e940>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:01.067427 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-109b18f8-911c-48a4-876e-3098ec6aef7f tempest-VolumesTestJSON-1603157422 tempest-VolumesTestJSON-1603157422-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.345973 May 13 17:27:01.067427 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 25/55] 10.222.0.64 () {58 vars in 1133 bytes} [Fri May 13 17:27:00 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:01.069786 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9132d5b6-0b81-4038-9687-9b4f9b1ee2b9 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:01.070407 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9132d5b6-0b81-4038-9687-9b4f9b1ee2b9 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:01.212314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9132d5b6-0b81-4038-9687-9b4f9b1ee2b9 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:01.223942 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-2b1bd0b6-e3c5-4158-a668-2a0674da5c55 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:01.244100 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9132d5b6-0b81-4038-9687-9b4f9b1ee2b9 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1241 microversion: 2.1 time: 0.172719 May 13 17:27:01.244100 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 26/56] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:01 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1241 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:01.245781 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-2b1bd0b6-e3c5-4158-a668-2a0674da5c55 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.950741 May 13 17:27:01.246360 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 31/57] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:00 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:01.250700 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-aee4ab90-edf6-4f3a-a27f-9d6d6ce482d0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:01.251347 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-aee4ab90-edf6-4f3a-a27f-9d6d6ce482d0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:01.278374 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-259837e4-c9ba-4e46-8485-29deb79276c7 tempest-VolumesTestJSON-1603157422 tempest-VolumesTestJSON-1603157422-project] Calling method '.version_select at 0x7fa08574c700>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:01.493244 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-aee4ab90-edf6-4f3a-a27f-9d6d6ce482d0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:01.524422 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-aee4ab90-edf6-4f3a-a27f-9d6d6ce482d0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:01.527947 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-aee4ab90-edf6-4f3a-a27f-9d6d6ce482d0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:01.529931 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-aee4ab90-edf6-4f3a-a27f-9d6d6ce482d0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1282 microversion: 2.20 time: 0.286793 May 13 17:27:01.532421 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 27/58] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:01 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1282 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:01.604224 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-259837e4-c9ba-4e46-8485-29deb79276c7 tempest-VolumesTestJSON-1603157422 tempest-VolumesTestJSON-1603157422-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.354852 May 13 17:27:01.604842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 32/59] 10.222.0.64 () {58 vars in 1166 bytes} [Fri May 13 17:27:01 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:27:01.618832 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-59d751a2-c72a-4969-98e4-0b287fb9ad3f tempest-VolumesTestJSON-1603157422 tempest-VolumesTestJSON-1603157422-project] Calling method '.version_select at 0x7fa085f3ddc0>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:01.734544 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-62e77019-14ab-4f80-b60d-eafe8eab0c61 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1403824365", "imageRef": "7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "975cbf16-d3c5-4b6b-98f2-e842c863e717"}], "security_groups": [{"name": "tempest-securitygroup--1927897686"}], "key_name": "tempest-keypair-1645480836", "user_data": "}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:27:01.854492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-59d751a2-c72a-4969-98e4-0b287fb9ad3f tempest-VolumesTestJSON-1603157422 tempest-VolumesTestJSON-1603157422-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.239836 May 13 17:27:01.858809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 28/60] 10.222.0.64 () {58 vars in 1169 bytes} [Fri May 13 17:27:01 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:27:01.891082 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-87f456ca-3098-451c-81bf-68320e82519e tempest-VolumesTestJSON-1603157422 tempest-VolumesTestJSON-1603157422-project] Calling method '.version_select at 0x7fa085f4dc10>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:02.024415 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.network.neutron [None req-62e77019-14ab-4f80-b60d-eafe8eab0c61 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] validate_networks() for [('975cbf16-d3c5-4b6b-98f2-e842c863e717', None, None, None, None, None)] {{(pid=117492) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 17:27:02.113347 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-87f456ca-3098-451c-81bf-68320e82519e tempest-VolumesTestJSON-1603157422 tempest-VolumesTestJSON-1603157422-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.236918 May 13 17:27:02.114166 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 29/61] 10.222.0.64 () {58 vars in 1154 bytes} [Fri May 13 17:27:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:02.129808 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e70a6419-5897-4310-aaf1-84c0b72be79b tempest-VolumesTestJSON-1603157422 tempest-VolumesTestJSON-1603157422-project] Calling method '.version_select at 0x7fa085f3ddc0>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:02.370967 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e70a6419-5897-4310-aaf1-84c0b72be79b tempest-VolumesTestJSON-1603157422 tempest-VolumesTestJSON-1603157422-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.246445 May 13 17:27:02.371841 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 30/62] 10.222.0.64 () {58 vars in 1187 bytes} [Fri May 13 17:27:02 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:27:02.380327 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0cb44fd8-a00c-4554-9df4-7c80ba9c6580 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:02.381109 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0cb44fd8-a00c-4554-9df4-7c80ba9c6580 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:02.857660 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0cb44fd8-a00c-4554-9df4-7c80ba9c6580 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:02.869211 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0cb44fd8-a00c-4554-9df4-7c80ba9c6580 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1241 microversion: 2.1 time: 0.492597 May 13 17:27:02.878590 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 31/63] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:02 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1241 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:02.890111 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-421d140e-c34a-4f98-a6c4-df96194e2dba tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:02.890741 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-421d140e-c34a-4f98-a6c4-df96194e2dba tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:02.898783 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-421d140e-c34a-4f98-a6c4-df96194e2dba tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:02.913681 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-421d140e-c34a-4f98-a6c4-df96194e2dba tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:02.914617 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-62e77019-14ab-4f80-b60d-eafe8eab0c61 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Flavor limits 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 17:27:02.915117 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-421d140e-c34a-4f98-a6c4-df96194e2dba tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:02.915218 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-62e77019-14ab-4f80-b60d-eafe8eab0c61 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Image limits 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 17:27:02.915299 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-421d140e-c34a-4f98-a6c4-df96194e2dba tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:02.917597 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-62e77019-14ab-4f80-b60d-eafe8eab0c61 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Flavor pref 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 17:27:02.918577 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-62e77019-14ab-4f80-b60d-eafe8eab0c61 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Image pref 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 17:27:02.920249 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-62e77019-14ab-4f80-b60d-eafe8eab0c61 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 17:27:02.937909 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-62e77019-14ab-4f80-b60d-eafe8eab0c61 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:02.938368 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-62e77019-14ab-4f80-b60d-eafe8eab0c61 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:02.939682 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-62e77019-14ab-4f80-b60d-eafe8eab0c61 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:02.940535 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-62e77019-14ab-4f80-b60d-eafe8eab0c61 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:02.984461 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-62e77019-14ab-4f80-b60d-eafe8eab0c61 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Getting quotas for project f8e7b818f3a74fc48f0faeeb3398069a. Resources: {'ram', 'instances', 'cores'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:27:03.009980 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-62e77019-14ab-4f80-b60d-eafe8eab0c61 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Getting quotas for user efc23cbdbebc423baed1a2cb6c6cd7e7 and project f8e7b818f3a74fc48f0faeeb3398069a. Resources: {'ram', 'instances', 'cores'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:27:03.049766 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-62e77019-14ab-4f80-b60d-eafe8eab0c61 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Going to run 1 instances... {{(pid=117492) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 17:27:03.052033 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-62e77019-14ab-4f80-b60d-eafe8eab0c61 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 17:27:03.224023 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-62e77019-14ab-4f80-b60d-eafe8eab0c61 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.493993 May 13 17:27:03.224839 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 33/64] 10.222.0.64 () {60 vars in 1146 bytes} [Fri May 13 17:27:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 1495 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 17:27:03.235502 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-ee17fdd9-3eaf-464e-99aa-aceafb0f41d5 tempest-VolumesTestJSON-1603157422 tempest-VolumesTestJSON-1603157422-project] Calling method '.version_select at 0x7fa084edcb80>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:03.361917 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-421d140e-c34a-4f98-a6c4-df96194e2dba tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:03.374501 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-421d140e-c34a-4f98-a6c4-df96194e2dba tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.491693 May 13 17:27:03.377705 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 32/65] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:02 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:03.378450 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-ee17fdd9-3eaf-464e-99aa-aceafb0f41d5 tempest-VolumesTestJSON-1603157422 tempest-VolumesTestJSON-1603157422-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.147197 May 13 17:27:03.396568 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-75c1aac7-8070-4fbd-9559-78e1b4309feb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:03.406258 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-75c1aac7-8070-4fbd-9559-78e1b4309feb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:03.406509 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 34/66] 10.222.0.64 () {58 vars in 1154 bytes} [Fri May 13 17:27:03 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:03.420745 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-2db94317-4329-46ac-b93e-cffc84761b5c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:03.424394 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-2db94317-4329-46ac-b93e-cffc84761b5c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:03.437806 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-75c1aac7-8070-4fbd-9559-78e1b4309feb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:03.440697 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-75c1aac7-8070-4fbd-9559-78e1b4309feb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:03.443358 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-75c1aac7-8070-4fbd-9559-78e1b4309feb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:03.448279 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-75c1aac7-8070-4fbd-9559-78e1b4309feb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:03.663094 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-75c1aac7-8070-4fbd-9559-78e1b4309feb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:03.676744 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-75c1aac7-8070-4fbd-9559-78e1b4309feb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:03.682320 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-75c1aac7-8070-4fbd-9559-78e1b4309feb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:03.684980 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-75c1aac7-8070-4fbd-9559-78e1b4309feb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1334 microversion: 2.20 time: 0.305223 May 13 17:27:03.687204 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 33/67] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:03 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1334 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:03.748346 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-2db94317-4329-46ac-b93e-cffc84761b5c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:03.758664 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-2db94317-4329-46ac-b93e-cffc84761b5c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1238 microversion: 2.1 time: 0.350614 May 13 17:27:03.763187 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 35/68] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:03 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1238 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:03.903075 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-50441bcb-356d-4f97-86f0-0c5b8aa21438 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:03.904154 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-50441bcb-356d-4f97-86f0-0c5b8aa21438 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:03.923170 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-50441bcb-356d-4f97-86f0-0c5b8aa21438 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:03.925034 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-50441bcb-356d-4f97-86f0-0c5b8aa21438 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:03.927829 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-50441bcb-356d-4f97-86f0-0c5b8aa21438 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:03.934206 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-50441bcb-356d-4f97-86f0-0c5b8aa21438 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:04.078849 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-50441bcb-356d-4f97-86f0-0c5b8aa21438 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:04.106625 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-50441bcb-356d-4f97-86f0-0c5b8aa21438 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1237 microversion: 2.1 time: 0.216473 May 13 17:27:04.117250 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 34/69] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:03 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1237 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:04.394554 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3a73b44c-8669-43c1-8fd2-824092989a63 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:04.395361 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3a73b44c-8669-43c1-8fd2-824092989a63 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:04.402525 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3a73b44c-8669-43c1-8fd2-824092989a63 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:04.406207 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3a73b44c-8669-43c1-8fd2-824092989a63 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:04.407249 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3a73b44c-8669-43c1-8fd2-824092989a63 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:04.416118 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3a73b44c-8669-43c1-8fd2-824092989a63 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:04.706301 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-98f2b6fc-7eb3-4bb2-b475-afb034e63eef tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:04.707256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-98f2b6fc-7eb3-4bb2-b475-afb034e63eef tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:04.737222 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3a73b44c-8669-43c1-8fd2-824092989a63 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:04.745677 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-98f2b6fc-7eb3-4bb2-b475-afb034e63eef tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:04.748064 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3a73b44c-8669-43c1-8fd2-824092989a63 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.356324 May 13 17:27:04.750058 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 36/70] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:04 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:04.755228 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-98f2b6fc-7eb3-4bb2-b475-afb034e63eef tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:04.763752 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-98f2b6fc-7eb3-4bb2-b475-afb034e63eef tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:04.764580 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-98f2b6fc-7eb3-4bb2-b475-afb034e63eef tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:04.779668 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-c501f85d-df2c-4a46-bc4f-89ec13ba02c3 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:04.780948 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-c501f85d-df2c-4a46-bc4f-89ec13ba02c3 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:05.021358 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c501f85d-df2c-4a46-bc4f-89ec13ba02c3 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:05.026339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-98f2b6fc-7eb3-4bb2-b475-afb034e63eef tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:05.044836 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-c501f85d-df2c-4a46-bc4f-89ec13ba02c3 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1238 microversion: 2.1 time: 0.269246 May 13 17:27:05.046724 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 37/71] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:04 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1238 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:05.051846 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-98f2b6fc-7eb3-4bb2-b475-afb034e63eef tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:05.051846 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-98f2b6fc-7eb3-4bb2-b475-afb034e63eef tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:05.053309 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-98f2b6fc-7eb3-4bb2-b475-afb034e63eef tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1340 microversion: 2.20 time: 0.351712 May 13 17:27:05.054053 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 35/72] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:04 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1340 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:05.128739 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-4a66b711-e95e-4fa0-94b3-11396751e8cf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:05.129686 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-4a66b711-e95e-4fa0-94b3-11396751e8cf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:05.141928 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4a66b711-e95e-4fa0-94b3-11396751e8cf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:05.143777 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4a66b711-e95e-4fa0-94b3-11396751e8cf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:05.147720 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4a66b711-e95e-4fa0-94b3-11396751e8cf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:05.149638 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4a66b711-e95e-4fa0-94b3-11396751e8cf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:05.324188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-4a66b711-e95e-4fa0-94b3-11396751e8cf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:05.337009 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-4a66b711-e95e-4fa0-94b3-11396751e8cf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1293 microversion: 2.1 time: 0.211970 May 13 17:27:05.337009 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 38/73] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:05 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1293 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:05.766033 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-bc3c9048-a6f5-4474-b0c2-6118f407ccee tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:05.767673 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-bc3c9048-a6f5-4474-b0c2-6118f407ccee tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:05.780567 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bc3c9048-a6f5-4474-b0c2-6118f407ccee tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:05.783663 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bc3c9048-a6f5-4474-b0c2-6118f407ccee tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:05.791789 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bc3c9048-a6f5-4474-b0c2-6118f407ccee tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:05.791789 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bc3c9048-a6f5-4474-b0c2-6118f407ccee tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:06.128036 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-455f207e-175c-4203-8b51-1d500ad06286 req-7d9b42ba-3143-4d5c-9437-2a7909e7abde service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebfc247d-ad6b-43f7-adec-b9054fefa3a1", "tag": "52e61d3c-72e9-427b-ac8a-8ad080ce50d0"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:27:06.181492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-455f207e-175c-4203-8b51-1d500ad06286 req-7d9b42ba-3143-4d5c-9437-2a7909e7abde service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:06.182767 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-455f207e-175c-4203-8b51-1d500ad06286 req-7d9b42ba-3143-4d5c-9437-2a7909e7abde service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:06.222066 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-455f207e-175c-4203-8b51-1d500ad06286 req-7d9b42ba-3143-4d5c-9437-2a7909e7abde service nova] Creating event network-changed:52e61d3c-72e9-427b-ac8a-8ad080ce50d0 for instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 on hv-cinder-84178 May 13 17:27:06.223603 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-455f207e-175c-4203-8b51-1d500ad06286 req-7d9b42ba-3143-4d5c-9437-2a7909e7abde service nova] Acquired lock "compute-rpcapi-router" {{(pid=117493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 13 17:27:06.224570 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8e051c36-5bb0-4901-97f7-5f9f228c1ddb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:06.225240 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8e051c36-5bb0-4901-97f7-5f9f228c1ddb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:06.226252 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8e051c36-5bb0-4901-97f7-5f9f228c1ddb None None] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:06.227380 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8e051c36-5bb0-4901-97f7-5f9f228c1ddb None None] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:06.249662 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.compute.rpcapi [None req-8e051c36-5bb0-4901-97f7-5f9f228c1ddb None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 13 17:27:06.252167 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8e051c36-5bb0-4901-97f7-5f9f228c1ddb None None] Releasing lock "compute-rpcapi-router" {{(pid=117493) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 13 17:27:06.290384 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8e051c36-5bb0-4901-97f7-5f9f228c1ddb None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.574280 May 13 17:27:06.295061 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 36/74] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:27:06.300739 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-808b3161-d786-4460-9107-d923b9e9704f tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:06.306313 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-808b3161-d786-4460-9107-d923b9e9704f tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:06.323554 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-808b3161-d786-4460-9107-d923b9e9704f tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:06.324378 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-808b3161-d786-4460-9107-d923b9e9704f tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:06.325277 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-808b3161-d786-4460-9107-d923b9e9704f tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:06.329830 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-808b3161-d786-4460-9107-d923b9e9704f tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:06.455072 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-808b3161-d786-4460-9107-d923b9e9704f tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:06.462616 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-808b3161-d786-4460-9107-d923b9e9704f tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1290 microversion: 2.1 time: 0.166043 May 13 17:27:06.479207 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 37/75] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:06 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1290 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:06.484797 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-90b15897-b7ef-439d-966f-364686adeecc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:06.487783 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-90b15897-b7ef-439d-966f-364686adeecc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:06.508317 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-90b15897-b7ef-439d-966f-364686adeecc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:06.514890 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-90b15897-b7ef-439d-966f-364686adeecc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:06.514890 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-90b15897-b7ef-439d-966f-364686adeecc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:06.514890 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-90b15897-b7ef-439d-966f-364686adeecc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:06.547499 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-bc3c9048-a6f5-4474-b0c2-6118f407ccee tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:06.562261 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-bc3c9048-a6f5-4474-b0c2-6118f407ccee tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.800245 May 13 17:27:06.577262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 39/76] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:05 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 808 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:06.595780 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-aa9d8040-1a42-477e-8e6b-e833805bb4ba tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:06.596879 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-aa9d8040-1a42-477e-8e6b-e833805bb4ba tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:06.603618 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-aa9d8040-1a42-477e-8e6b-e833805bb4ba tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:06.604337 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-aa9d8040-1a42-477e-8e6b-e833805bb4ba tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:06.607686 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-aa9d8040-1a42-477e-8e6b-e833805bb4ba tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:06.608382 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-aa9d8040-1a42-477e-8e6b-e833805bb4ba tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:06.678012 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-90b15897-b7ef-439d-966f-364686adeecc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:06.690211 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-90b15897-b7ef-439d-966f-364686adeecc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:06.692289 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-90b15897-b7ef-439d-966f-364686adeecc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:06.693824 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-90b15897-b7ef-439d-966f-364686adeecc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1340 microversion: 2.20 time: 0.213344 May 13 17:27:06.695313 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 38/77] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:06 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1340 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:06.731446 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-aa9d8040-1a42-477e-8e6b-e833805bb4ba tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:06.747670 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-aa9d8040-1a42-477e-8e6b-e833805bb4ba tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1299 microversion: 2.1 time: 0.176149 May 13 17:27:06.752168 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 40/78] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:06 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1299 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:07.489935 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-764942c3-ba85-40ac-bc57-cde505bd57f4 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:07.490723 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-764942c3-ba85-40ac-bc57-cde505bd57f4 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:07.500131 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-764942c3-ba85-40ac-bc57-cde505bd57f4 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:07.500131 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-764942c3-ba85-40ac-bc57-cde505bd57f4 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:07.500131 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-764942c3-ba85-40ac-bc57-cde505bd57f4 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:07.501587 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-764942c3-ba85-40ac-bc57-cde505bd57f4 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:07.597746 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-cb5890f1-78f0-4050-a2db-92675dd58c87 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:07.599484 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-cb5890f1-78f0-4050-a2db-92675dd58c87 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:07.609422 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cb5890f1-78f0-4050-a2db-92675dd58c87 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:07.609708 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cb5890f1-78f0-4050-a2db-92675dd58c87 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:07.610811 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cb5890f1-78f0-4050-a2db-92675dd58c87 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:07.611645 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cb5890f1-78f0-4050-a2db-92675dd58c87 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:07.684863 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-764942c3-ba85-40ac-bc57-cde505bd57f4 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:07.695971 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-764942c3-ba85-40ac-bc57-cde505bd57f4 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1298 microversion: 2.1 time: 0.213709 May 13 17:27:07.708137 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 39/79] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:07 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1298 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:07.722896 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8ba1d9af-acc1-4924-85ca-c19579cd0e8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:07.723732 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8ba1d9af-acc1-4924-85ca-c19579cd0e8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:07.745149 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8ba1d9af-acc1-4924-85ca-c19579cd0e8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:07.745764 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8ba1d9af-acc1-4924-85ca-c19579cd0e8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:07.746780 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8ba1d9af-acc1-4924-85ca-c19579cd0e8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:07.749778 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8ba1d9af-acc1-4924-85ca-c19579cd0e8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:08.195161 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-cb5890f1-78f0-4050-a2db-92675dd58c87 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:08.220756 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-cb5890f1-78f0-4050-a2db-92675dd58c87 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.630780 May 13 17:27:08.225074 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 41/80] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:07 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 636 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:27:08.244822 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f84fbdf5-fe29-47c9-a19f-a6b8552af679 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:08.250537 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-f84fbdf5-fe29-47c9-a19f-a6b8552af679 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:08.273832 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f84fbdf5-fe29-47c9-a19f-a6b8552af679 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:08.282812 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f84fbdf5-fe29-47c9-a19f-a6b8552af679 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:08.284015 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f84fbdf5-fe29-47c9-a19f-a6b8552af679 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:08.291895 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f84fbdf5-fe29-47c9-a19f-a6b8552af679 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:08.619932 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8ba1d9af-acc1-4924-85ca-c19579cd0e8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:08.630563 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8ba1d9af-acc1-4924-85ca-c19579cd0e8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:08.646160 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8ba1d9af-acc1-4924-85ca-c19579cd0e8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:08.646160 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8ba1d9af-acc1-4924-85ca-c19579cd0e8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.933520 May 13 17:27:08.646160 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 40/81] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:07 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 935 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:08.671941 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f84fbdf5-fe29-47c9-a19f-a6b8552af679 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:08.682907 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f84fbdf5-fe29-47c9-a19f-a6b8552af679 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.454192 May 13 17:27:08.687439 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 42/82] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:08 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:08.725043 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7bf56292-7475-4193-a71e-e032be276d50 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:08.725199 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7bf56292-7475-4193-a71e-e032be276d50 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:08.733198 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7bf56292-7475-4193-a71e-e032be276d50 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:08.735766 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7bf56292-7475-4193-a71e-e032be276d50 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:08.736881 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7bf56292-7475-4193-a71e-e032be276d50 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:08.738559 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7bf56292-7475-4193-a71e-e032be276d50 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:09.137564 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7bf56292-7475-4193-a71e-e032be276d50 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:09.158280 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7bf56292-7475-4193-a71e-e032be276d50 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1296 microversion: 2.1 time: 0.433914 May 13 17:27:09.158280 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 41/83] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:08 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1296 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:09.245087 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-eff2c486-4d02-474f-b763-8fa05b1046f1 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:09.245949 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-eff2c486-4d02-474f-b763-8fa05b1046f1 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:09.262225 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-eff2c486-4d02-474f-b763-8fa05b1046f1 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:09.263260 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-eff2c486-4d02-474f-b763-8fa05b1046f1 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:09.265730 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-eff2c486-4d02-474f-b763-8fa05b1046f1 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:09.266469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-eff2c486-4d02-474f-b763-8fa05b1046f1 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:09.665078 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-586664d4-7e8d-4567-8e9e-ad46862588cc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:09.667098 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-586664d4-7e8d-4567-8e9e-ad46862588cc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:09.682241 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-586664d4-7e8d-4567-8e9e-ad46862588cc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:09.683156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-586664d4-7e8d-4567-8e9e-ad46862588cc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:09.686368 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-586664d4-7e8d-4567-8e9e-ad46862588cc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:09.687696 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-586664d4-7e8d-4567-8e9e-ad46862588cc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:09.795713 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-eff2c486-4d02-474f-b763-8fa05b1046f1 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:09.806749 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-eff2c486-4d02-474f-b763-8fa05b1046f1 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.565334 May 13 17:27:09.813462 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 43/84] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:09 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:09.833319 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-319efdc3-4356-47b7-9712-9033dd28f7a3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:09.834232 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-319efdc3-4356-47b7-9712-9033dd28f7a3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:09.857514 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-319efdc3-4356-47b7-9712-9033dd28f7a3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:09.862290 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-319efdc3-4356-47b7-9712-9033dd28f7a3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:09.868883 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-319efdc3-4356-47b7-9712-9033dd28f7a3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:09.870181 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-319efdc3-4356-47b7-9712-9033dd28f7a3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:10.219403 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-319efdc3-4356-47b7-9712-9033dd28f7a3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:10.241009 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-319efdc3-4356-47b7-9712-9033dd28f7a3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.425993 May 13 17:27:10.244922 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 44/85] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:09 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:10.253490 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-0798dcf0-fe58-4c96-b4d8-eefdf3e2041a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:10.257228 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-586664d4-7e8d-4567-8e9e-ad46862588cc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:10.269411 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-0798dcf0-fe58-4c96-b4d8-eefdf3e2041a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:10.283760 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-586664d4-7e8d-4567-8e9e-ad46862588cc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:10.283760 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-586664d4-7e8d-4567-8e9e-ad46862588cc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:10.283760 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-586664d4-7e8d-4567-8e9e-ad46862588cc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.620138 May 13 17:27:10.284055 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 42/86] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:09 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:10.285265 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0798dcf0-fe58-4c96-b4d8-eefdf3e2041a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:10.290795 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0798dcf0-fe58-4c96-b4d8-eefdf3e2041a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:10.291931 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0798dcf0-fe58-4c96-b4d8-eefdf3e2041a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:10.293821 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0798dcf0-fe58-4c96-b4d8-eefdf3e2041a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:10.558430 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0798dcf0-fe58-4c96-b4d8-eefdf3e2041a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:10.578736 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-0798dcf0-fe58-4c96-b4d8-eefdf3e2041a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1296 microversion: 2.1 time: 0.332312 May 13 17:27:10.581160 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 45/87] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:10 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1296 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:10.829435 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8b603e82-eb30-4baf-93bf-0f3628c87425 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:10.830066 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8b603e82-eb30-4baf-93bf-0f3628c87425 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:10.841574 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8b603e82-eb30-4baf-93bf-0f3628c87425 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:10.848561 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8b603e82-eb30-4baf-93bf-0f3628c87425 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:10.849760 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8b603e82-eb30-4baf-93bf-0f3628c87425 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:10.850426 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8b603e82-eb30-4baf-93bf-0f3628c87425 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:11.120536 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8b603e82-eb30-4baf-93bf-0f3628c87425 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:11.131510 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8b603e82-eb30-4baf-93bf-0f3628c87425 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.306102 May 13 17:27:11.132133 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 43/88] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:10 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:27:11.273561 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a1d69594-c8a2-4e25-8731-3cfa9f1c8551 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:11.273561 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a1d69594-c8a2-4e25-8731-3cfa9f1c8551 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:11.273561 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a1d69594-c8a2-4e25-8731-3cfa9f1c8551 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:11.273561 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a1d69594-c8a2-4e25-8731-3cfa9f1c8551 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:11.274333 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a1d69594-c8a2-4e25-8731-3cfa9f1c8551 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:11.274333 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a1d69594-c8a2-4e25-8731-3cfa9f1c8551 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:11.300819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-eddd57c5-046c-44cd-b9fa-02909a0f26bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:11.301507 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-eddd57c5-046c-44cd-b9fa-02909a0f26bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:11.319009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eddd57c5-046c-44cd-b9fa-02909a0f26bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:11.319528 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eddd57c5-046c-44cd-b9fa-02909a0f26bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:11.320293 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eddd57c5-046c-44cd-b9fa-02909a0f26bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:11.320737 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eddd57c5-046c-44cd-b9fa-02909a0f26bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:11.507580 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a1d69594-c8a2-4e25-8731-3cfa9f1c8551 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:11.521347 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a1d69594-c8a2-4e25-8731-3cfa9f1c8551 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.261459 May 13 17:27:11.523299 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 46/89] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:11 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:11.597196 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-19f0dc8a-e89d-4ebd-91cc-ccac52884261 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:11.597809 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-19f0dc8a-e89d-4ebd-91cc-ccac52884261 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:11.603749 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-19f0dc8a-e89d-4ebd-91cc-ccac52884261 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:11.604402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-19f0dc8a-e89d-4ebd-91cc-ccac52884261 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:11.605183 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-19f0dc8a-e89d-4ebd-91cc-ccac52884261 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:11.605635 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-19f0dc8a-e89d-4ebd-91cc-ccac52884261 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:11.618514 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-eddd57c5-046c-44cd-b9fa-02909a0f26bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:11.628949 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-eddd57c5-046c-44cd-b9fa-02909a0f26bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:11.630791 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-eddd57c5-046c-44cd-b9fa-02909a0f26bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:11.631947 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-eddd57c5-046c-44cd-b9fa-02909a0f26bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.336216 May 13 17:27:11.632676 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 44/90] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:11 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:11.687607 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-19f0dc8a-e89d-4ebd-91cc-ccac52884261 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:11.695867 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-19f0dc8a-e89d-4ebd-91cc-ccac52884261 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1296 microversion: 2.1 time: 0.103215 May 13 17:27:11.697412 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 47/91] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:11 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1296 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:11.768102 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-2c48abff-1ccc-4b8a-8967-c733c00a6a7a req-fb6e4cf4-db2f-4fbc-9c11-2ad7e15145e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65fdbf1a-f080-4d79-b3f3-c465e5a81c67", "tag": "41053781-3367-4859-b7f7-eb83af021a82"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:27:11.815422 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-2c48abff-1ccc-4b8a-8967-c733c00a6a7a req-fb6e4cf4-db2f-4fbc-9c11-2ad7e15145e2 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:11.819889 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-2c48abff-1ccc-4b8a-8967-c733c00a6a7a req-fb6e4cf4-db2f-4fbc-9c11-2ad7e15145e2 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:11.857336 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-2c48abff-1ccc-4b8a-8967-c733c00a6a7a req-fb6e4cf4-db2f-4fbc-9c11-2ad7e15145e2 service nova] Creating event network-changed:41053781-3367-4859-b7f7-eb83af021a82 for instance 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 on hv-cinder-84178 May 13 17:27:11.869951 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-2c48abff-1ccc-4b8a-8967-c733c00a6a7a req-fb6e4cf4-db2f-4fbc-9c11-2ad7e15145e2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106311 May 13 17:27:11.875456 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 45/92] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:27:12.149967 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-e55e20f9-299e-433c-8fba-66af6eb7d906 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:12.150616 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-e55e20f9-299e-433c-8fba-66af6eb7d906 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:12.158834 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e55e20f9-299e-433c-8fba-66af6eb7d906 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:12.162061 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e55e20f9-299e-433c-8fba-66af6eb7d906 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:12.163035 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e55e20f9-299e-433c-8fba-66af6eb7d906 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:12.165165 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e55e20f9-299e-433c-8fba-66af6eb7d906 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:12.512628 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-e55e20f9-299e-433c-8fba-66af6eb7d906 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:12.523596 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-e55e20f9-299e-433c-8fba-66af6eb7d906 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.377412 May 13 17:27:12.525103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 48/93] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:12 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:12.541176 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f9753aa7-368e-44b6-b9ac-e037b7f4de74 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:12.541546 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f9753aa7-368e-44b6-b9ac-e037b7f4de74 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:12.550319 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f9753aa7-368e-44b6-b9ac-e037b7f4de74 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:12.551064 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f9753aa7-368e-44b6-b9ac-e037b7f4de74 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:12.552183 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f9753aa7-368e-44b6-b9ac-e037b7f4de74 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:12.552956 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f9753aa7-368e-44b6-b9ac-e037b7f4de74 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:12.655168 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-73f5a093-5a61-446d-93d0-832a09a06f95 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:12.655795 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-73f5a093-5a61-446d-93d0-832a09a06f95 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:12.662138 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-73f5a093-5a61-446d-93d0-832a09a06f95 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:12.662599 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-73f5a093-5a61-446d-93d0-832a09a06f95 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:12.665334 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-73f5a093-5a61-446d-93d0-832a09a06f95 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:12.667159 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-73f5a093-5a61-446d-93d0-832a09a06f95 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:12.902026 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f9753aa7-368e-44b6-b9ac-e037b7f4de74 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:12.913101 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f9753aa7-368e-44b6-b9ac-e037b7f4de74 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.377062 May 13 17:27:12.913755 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 46/94] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:12 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:12.922022 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3c43bdea-37c7-4326-a8c6-a9eb2bb7e990 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:12.922633 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3c43bdea-37c7-4326-a8c6-a9eb2bb7e990 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:12.933222 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3c43bdea-37c7-4326-a8c6-a9eb2bb7e990 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:12.933703 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3c43bdea-37c7-4326-a8c6-a9eb2bb7e990 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:12.935768 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3c43bdea-37c7-4326-a8c6-a9eb2bb7e990 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:12.936617 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3c43bdea-37c7-4326-a8c6-a9eb2bb7e990 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:12.973886 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-73f5a093-5a61-446d-93d0-832a09a06f95 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:12.985752 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-73f5a093-5a61-446d-93d0-832a09a06f95 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:12.996863 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-73f5a093-5a61-446d-93d0-832a09a06f95 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:12.998020 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-73f5a093-5a61-446d-93d0-832a09a06f95 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.346845 May 13 17:27:12.998742 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 49/95] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:12 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:27:13.124835 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3c43bdea-37c7-4326-a8c6-a9eb2bb7e990 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:13.132608 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3c43bdea-37c7-4326-a8c6-a9eb2bb7e990 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.216591 May 13 17:27:13.133173 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 47/96] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:12 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:13.541329 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-8db428ef-7627-41a9-adfa-ee1ee2110730 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:13.542032 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-8db428ef-7627-41a9-adfa-ee1ee2110730 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:13.548061 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8db428ef-7627-41a9-adfa-ee1ee2110730 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:13.548922 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8db428ef-7627-41a9-adfa-ee1ee2110730 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:13.549775 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8db428ef-7627-41a9-adfa-ee1ee2110730 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:13.550313 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8db428ef-7627-41a9-adfa-ee1ee2110730 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:13.690817 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-8db428ef-7627-41a9-adfa-ee1ee2110730 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:13.704733 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-8db428ef-7627-41a9-adfa-ee1ee2110730 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.167526 May 13 17:27:13.705518 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 50/97] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:13 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:13.905838 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-96b7d711-c7d5-4f5a-a9b8-c93eafa38843 req-0f3bd63d-b72e-4eec-bfb3-57c451c5e1cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "271501e4-dcad-4de1-92a7-8ad28c0dc5e0", "tag": "6c67b852-5901-4a54-9821-0cbca68ceaca"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:27:13.914784 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-96b7d711-c7d5-4f5a-a9b8-c93eafa38843 req-0f3bd63d-b72e-4eec-bfb3-57c451c5e1cb service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:13.915257 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-96b7d711-c7d5-4f5a-a9b8-c93eafa38843 req-0f3bd63d-b72e-4eec-bfb3-57c451c5e1cb service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:13.926494 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-96b7d711-c7d5-4f5a-a9b8-c93eafa38843 req-0f3bd63d-b72e-4eec-bfb3-57c451c5e1cb service nova] Creating event network-changed:6c67b852-5901-4a54-9821-0cbca68ceaca for instance 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 on hv-cinder-84178 May 13 17:27:13.931368 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-96b7d711-c7d5-4f5a-a9b8-c93eafa38843 req-0f3bd63d-b72e-4eec-bfb3-57c451c5e1cb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031652 May 13 17:27:13.931488 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-70dd1f69-6790-4601-8699-f5aecf6b6b98 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:13.931959 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 48/98] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:27:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:27:13.934928 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-70dd1f69-6790-4601-8699-f5aecf6b6b98 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:13.940895 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-70dd1f69-6790-4601-8699-f5aecf6b6b98 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:13.941410 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-70dd1f69-6790-4601-8699-f5aecf6b6b98 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:13.942506 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-70dd1f69-6790-4601-8699-f5aecf6b6b98 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:13.942948 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-70dd1f69-6790-4601-8699-f5aecf6b6b98 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:14.017409 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6b9b02ba-d06a-42f1-bc22-63cf4f8c3ee5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:14.018172 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6b9b02ba-d06a-42f1-bc22-63cf4f8c3ee5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:14.028774 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b9b02ba-d06a-42f1-bc22-63cf4f8c3ee5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:14.029294 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b9b02ba-d06a-42f1-bc22-63cf4f8c3ee5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:14.030647 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b9b02ba-d06a-42f1-bc22-63cf4f8c3ee5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:14.031101 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b9b02ba-d06a-42f1-bc22-63cf4f8c3ee5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:14.117213 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-70dd1f69-6790-4601-8699-f5aecf6b6b98 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:14.117213 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-70dd1f69-6790-4601-8699-f5aecf6b6b98 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.187037 May 13 17:27:14.117213 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 51/99] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:13 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:27:14.149633 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-275206d4-c7d2-4f4d-9139-0446370efd24 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:14.150249 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-275206d4-c7d2-4f4d-9139-0446370efd24 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:14.157758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-275206d4-c7d2-4f4d-9139-0446370efd24 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:14.159072 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-275206d4-c7d2-4f4d-9139-0446370efd24 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:14.165782 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-275206d4-c7d2-4f4d-9139-0446370efd24 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:14.165782 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-275206d4-c7d2-4f4d-9139-0446370efd24 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:14.297609 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-275206d4-c7d2-4f4d-9139-0446370efd24 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:14.305951 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-275206d4-c7d2-4f4d-9139-0446370efd24 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.159957 May 13 17:27:14.307270 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 52/100] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:14 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:14.614814 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6b9b02ba-d06a-42f1-bc22-63cf4f8c3ee5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:14.631281 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6b9b02ba-d06a-42f1-bc22-63cf4f8c3ee5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:14.633050 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6b9b02ba-d06a-42f1-bc22-63cf4f8c3ee5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:14.634345 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6b9b02ba-d06a-42f1-bc22-63cf4f8c3ee5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.622196 May 13 17:27:14.635393 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 49/101] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:14 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:27:14.727205 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-45cab27d-1628-4c01-bf73-eda7d2e2bff3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:14.728134 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-45cab27d-1628-4c01-bf73-eda7d2e2bff3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:14.736419 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-45cab27d-1628-4c01-bf73-eda7d2e2bff3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:14.737465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-45cab27d-1628-4c01-bf73-eda7d2e2bff3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:14.738572 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-45cab27d-1628-4c01-bf73-eda7d2e2bff3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:14.739599 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-45cab27d-1628-4c01-bf73-eda7d2e2bff3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:14.910498 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-45cab27d-1628-4c01-bf73-eda7d2e2bff3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:14.918751 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-45cab27d-1628-4c01-bf73-eda7d2e2bff3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.198520 May 13 17:27:14.920421 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 53/102] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:14 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:15.133574 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ff977de1-1b48-4a84-ace3-7127d67dfbaf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:15.134263 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ff977de1-1b48-4a84-ace3-7127d67dfbaf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:15.141398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ff977de1-1b48-4a84-ace3-7127d67dfbaf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:15.141864 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ff977de1-1b48-4a84-ace3-7127d67dfbaf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:15.142639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ff977de1-1b48-4a84-ace3-7127d67dfbaf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:15.143338 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ff977de1-1b48-4a84-ace3-7127d67dfbaf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:15.323716 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3e8f82bc-9c1a-4038-86fd-4c566e0bee1e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:15.325630 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3e8f82bc-9c1a-4038-86fd-4c566e0bee1e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:15.340602 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3e8f82bc-9c1a-4038-86fd-4c566e0bee1e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:15.341417 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3e8f82bc-9c1a-4038-86fd-4c566e0bee1e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:15.344502 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3e8f82bc-9c1a-4038-86fd-4c566e0bee1e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:15.346827 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3e8f82bc-9c1a-4038-86fd-4c566e0bee1e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:15.430465 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ff977de1-1b48-4a84-ace3-7127d67dfbaf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:15.451913 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ff977de1-1b48-4a84-ace3-7127d67dfbaf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.323590 May 13 17:27:15.456771 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 50/103] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:15 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:15.559632 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3e8f82bc-9c1a-4038-86fd-4c566e0bee1e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:15.583071 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3e8f82bc-9c1a-4038-86fd-4c566e0bee1e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.250777 May 13 17:27:15.583071 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 54/104] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:15 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:27:15.653237 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fa2ce09e-60cd-43d4-90dd-77f962c89031 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:15.653847 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fa2ce09e-60cd-43d4-90dd-77f962c89031 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:15.659782 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fa2ce09e-60cd-43d4-90dd-77f962c89031 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:15.660234 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fa2ce09e-60cd-43d4-90dd-77f962c89031 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:15.661008 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fa2ce09e-60cd-43d4-90dd-77f962c89031 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:15.661444 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fa2ce09e-60cd-43d4-90dd-77f962c89031 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:15.890002 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fa2ce09e-60cd-43d4-90dd-77f962c89031 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:15.899673 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fa2ce09e-60cd-43d4-90dd-77f962c89031 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:15.901873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fa2ce09e-60cd-43d4-90dd-77f962c89031 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:15.902357 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fa2ce09e-60cd-43d4-90dd-77f962c89031 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.252923 May 13 17:27:15.903164 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 51/105] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:15 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:15.937344 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6a363488-5b91-4195-9a9a-e361b573b120 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:15.938637 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6a363488-5b91-4195-9a9a-e361b573b120 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:15.946643 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-cc6653d6-c713-45f0-b614-305281361750 req-07d40e0a-ec53-4476-9299-35462895ff93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a72fdd8-ca24-4ae1-b007-7e22f411ad48", "tag": "65e4c296-6b3c-4eb9-a923-4c5f6eab3710"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:27:15.954271 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6a363488-5b91-4195-9a9a-e361b573b120 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:15.955024 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-cc6653d6-c713-45f0-b614-305281361750 req-07d40e0a-ec53-4476-9299-35462895ff93 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:15.955319 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6a363488-5b91-4195-9a9a-e361b573b120 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:15.955619 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-cc6653d6-c713-45f0-b614-305281361750 req-07d40e0a-ec53-4476-9299-35462895ff93 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:15.956554 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6a363488-5b91-4195-9a9a-e361b573b120 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:15.957195 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6a363488-5b91-4195-9a9a-e361b573b120 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:15.971846 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-cc6653d6-c713-45f0-b614-305281361750 req-07d40e0a-ec53-4476-9299-35462895ff93 service nova] Creating event network-changed:65e4c296-6b3c-4eb9-a923-4c5f6eab3710 for instance 9a72fdd8-ca24-4ae1-b007-7e22f411ad48 on hv-cinder-84178 May 13 17:27:15.977435 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-cc6653d6-c713-45f0-b614-305281361750 req-07d40e0a-ec53-4476-9299-35462895ff93 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033992 May 13 17:27:15.978094 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 52/106] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:27:16.118522 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6a363488-5b91-4195-9a9a-e361b573b120 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:16.126848 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6a363488-5b91-4195-9a9a-e361b573b120 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.194079 May 13 17:27:16.127682 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 55/107] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:15 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:16.471231 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7bbb9d2c-15d0-4ba4-b30a-b1ad09eb1ef2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:16.471930 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7bbb9d2c-15d0-4ba4-b30a-b1ad09eb1ef2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:16.478111 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7bbb9d2c-15d0-4ba4-b30a-b1ad09eb1ef2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:16.478560 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7bbb9d2c-15d0-4ba4-b30a-b1ad09eb1ef2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:16.479385 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7bbb9d2c-15d0-4ba4-b30a-b1ad09eb1ef2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:16.479824 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7bbb9d2c-15d0-4ba4-b30a-b1ad09eb1ef2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:16.588421 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-348969eb-18a6-4396-91ca-d2ac470839b7 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:16.589023 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-348969eb-18a6-4396-91ca-d2ac470839b7 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:16.597453 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-348969eb-18a6-4396-91ca-d2ac470839b7 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:16.597997 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-348969eb-18a6-4396-91ca-d2ac470839b7 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:16.599038 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-348969eb-18a6-4396-91ca-d2ac470839b7 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:16.599693 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-348969eb-18a6-4396-91ca-d2ac470839b7 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:16.633561 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7bbb9d2c-15d0-4ba4-b30a-b1ad09eb1ef2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:16.642166 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7bbb9d2c-15d0-4ba4-b30a-b1ad09eb1ef2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.175941 May 13 17:27:16.644123 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 53/108] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:16 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:16.752930 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-348969eb-18a6-4396-91ca-d2ac470839b7 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:16.800551 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-348969eb-18a6-4396-91ca-d2ac470839b7 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.177036 May 13 17:27:16.800551 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 56/109] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:16 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:16.921587 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-664186ba-3f8a-45d0-9a25-19d5a50bee9f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:16.922206 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-664186ba-3f8a-45d0-9a25-19d5a50bee9f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:16.928281 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-664186ba-3f8a-45d0-9a25-19d5a50bee9f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:16.928749 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-664186ba-3f8a-45d0-9a25-19d5a50bee9f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:16.929502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-664186ba-3f8a-45d0-9a25-19d5a50bee9f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:16.929939 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-664186ba-3f8a-45d0-9a25-19d5a50bee9f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:17.065168 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-664186ba-3f8a-45d0-9a25-19d5a50bee9f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:17.072809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-664186ba-3f8a-45d0-9a25-19d5a50bee9f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:17.074298 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-664186ba-3f8a-45d0-9a25-19d5a50bee9f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:17.078860 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-664186ba-3f8a-45d0-9a25-19d5a50bee9f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.158259 May 13 17:27:17.078860 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 54/110] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:16 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:27:17.145708 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-ca910b4d-16ec-4ad8-a023-a589aca92e74 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:17.146422 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-ca910b4d-16ec-4ad8-a023-a589aca92e74 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:17.153578 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ca910b4d-16ec-4ad8-a023-a589aca92e74 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:17.154233 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ca910b4d-16ec-4ad8-a023-a589aca92e74 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:17.155332 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ca910b4d-16ec-4ad8-a023-a589aca92e74 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:17.155952 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ca910b4d-16ec-4ad8-a023-a589aca92e74 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:17.298832 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-ca910b4d-16ec-4ad8-a023-a589aca92e74 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:17.306029 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-ca910b4d-16ec-4ad8-a023-a589aca92e74 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.165632 May 13 17:27:17.306593 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 57/111] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:17 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:17.660973 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6a13b8ce-12ef-49a4-a570-12fb0d090bd2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:17.661580 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6a13b8ce-12ef-49a4-a570-12fb0d090bd2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:17.667444 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6a13b8ce-12ef-49a4-a570-12fb0d090bd2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:17.667888 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6a13b8ce-12ef-49a4-a570-12fb0d090bd2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:17.668643 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6a13b8ce-12ef-49a4-a570-12fb0d090bd2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:17.669074 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6a13b8ce-12ef-49a4-a570-12fb0d090bd2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:17.791325 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-8942a319-5b42-4bb1-9248-ecf62400a437 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:17.793208 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-8942a319-5b42-4bb1-9248-ecf62400a437 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:17.801553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8942a319-5b42-4bb1-9248-ecf62400a437 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:17.802167 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8942a319-5b42-4bb1-9248-ecf62400a437 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:17.804198 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8942a319-5b42-4bb1-9248-ecf62400a437 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:17.804411 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6a13b8ce-12ef-49a4-a570-12fb0d090bd2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:17.805083 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8942a319-5b42-4bb1-9248-ecf62400a437 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:17.813498 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6a13b8ce-12ef-49a4-a570-12fb0d090bd2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.156140 May 13 17:27:17.814629 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 55/112] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:17 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:17.955713 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-8942a319-5b42-4bb1-9248-ecf62400a437 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:17.963475 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-8942a319-5b42-4bb1-9248-ecf62400a437 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.177199 May 13 17:27:17.964040 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 58/113] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:17 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:18.093738 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6eb2a5aa-ba9d-438b-ad3d-3243e0d8059a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:18.094930 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6eb2a5aa-ba9d-438b-ad3d-3243e0d8059a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:18.101802 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6eb2a5aa-ba9d-438b-ad3d-3243e0d8059a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:18.102254 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6eb2a5aa-ba9d-438b-ad3d-3243e0d8059a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:18.103034 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6eb2a5aa-ba9d-438b-ad3d-3243e0d8059a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:18.103643 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6eb2a5aa-ba9d-438b-ad3d-3243e0d8059a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:18.242739 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6eb2a5aa-ba9d-438b-ad3d-3243e0d8059a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:18.274425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6eb2a5aa-ba9d-438b-ad3d-3243e0d8059a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:18.293571 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6eb2a5aa-ba9d-438b-ad3d-3243e0d8059a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:18.293571 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6eb2a5aa-ba9d-438b-ad3d-3243e0d8059a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.187786 May 13 17:27:18.293571 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 56/114] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:18 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:18.322819 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f4a1f10c-13fb-42f6-a984-2f05fb250a40 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:18.323480 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-f4a1f10c-13fb-42f6-a984-2f05fb250a40 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:18.330185 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f4a1f10c-13fb-42f6-a984-2f05fb250a40 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:18.330737 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f4a1f10c-13fb-42f6-a984-2f05fb250a40 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:18.331571 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f4a1f10c-13fb-42f6-a984-2f05fb250a40 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:18.332014 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f4a1f10c-13fb-42f6-a984-2f05fb250a40 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:18.494060 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f4a1f10c-13fb-42f6-a984-2f05fb250a40 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:18.504495 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f4a1f10c-13fb-42f6-a984-2f05fb250a40 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.185477 May 13 17:27:18.505085 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 59/115] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:18 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:18.829815 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d35fd36d-2307-476e-b712-b85e4863276b tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:18.831075 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d35fd36d-2307-476e-b712-b85e4863276b tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:18.837137 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d35fd36d-2307-476e-b712-b85e4863276b tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:18.839966 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d35fd36d-2307-476e-b712-b85e4863276b tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:18.839966 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d35fd36d-2307-476e-b712-b85e4863276b tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:18.839966 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d35fd36d-2307-476e-b712-b85e4863276b tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:18.978756 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d35fd36d-2307-476e-b712-b85e4863276b tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:18.981315 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d5ff7e27-32e7-4254-9fe8-e70047954ddc tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:18.981931 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d5ff7e27-32e7-4254-9fe8-e70047954ddc tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:18.987083 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d35fd36d-2307-476e-b712-b85e4863276b tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.161178 May 13 17:27:18.988255 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 57/116] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:18 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:18.988435 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d5ff7e27-32e7-4254-9fe8-e70047954ddc tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:18.988867 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d5ff7e27-32e7-4254-9fe8-e70047954ddc tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:18.989646 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d5ff7e27-32e7-4254-9fe8-e70047954ddc tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:18.990088 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d5ff7e27-32e7-4254-9fe8-e70047954ddc tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:19.118819 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d5ff7e27-32e7-4254-9fe8-e70047954ddc tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:19.126215 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d5ff7e27-32e7-4254-9fe8-e70047954ddc tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.148791 May 13 17:27:19.126771 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 60/117] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:18 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:27:19.302106 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ab44fd34-08a7-45c6-9755-149ce0781691 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:19.302623 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ab44fd34-08a7-45c6-9755-149ce0781691 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:19.309030 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ab44fd34-08a7-45c6-9755-149ce0781691 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:19.309030 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ab44fd34-08a7-45c6-9755-149ce0781691 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:19.309816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ab44fd34-08a7-45c6-9755-149ce0781691 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:19.310245 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ab44fd34-08a7-45c6-9755-149ce0781691 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:19.459957 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ab44fd34-08a7-45c6-9755-149ce0781691 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:19.467200 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ab44fd34-08a7-45c6-9755-149ce0781691 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:19.469627 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ab44fd34-08a7-45c6-9755-149ce0781691 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:19.470751 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ab44fd34-08a7-45c6-9755-149ce0781691 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.173178 May 13 17:27:19.471323 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 58/118] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:19 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:19.521676 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a3adc2df-e283-4a84-a69c-cc742c3ef316 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:19.522287 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a3adc2df-e283-4a84-a69c-cc742c3ef316 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:19.528165 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a3adc2df-e283-4a84-a69c-cc742c3ef316 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:19.528613 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a3adc2df-e283-4a84-a69c-cc742c3ef316 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:19.529373 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a3adc2df-e283-4a84-a69c-cc742c3ef316 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:19.529810 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a3adc2df-e283-4a84-a69c-cc742c3ef316 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:19.795677 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a3adc2df-e283-4a84-a69c-cc742c3ef316 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:19.802932 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a3adc2df-e283-4a84-a69c-cc742c3ef316 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.285024 May 13 17:27:19.803527 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 61/119] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:19 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:20.004821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7a402a19-422b-4c6d-8351-19db80617751 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:20.005516 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7a402a19-422b-4c6d-8351-19db80617751 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:20.011887 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7a402a19-422b-4c6d-8351-19db80617751 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:20.012344 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7a402a19-422b-4c6d-8351-19db80617751 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:20.016795 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7a402a19-422b-4c6d-8351-19db80617751 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:20.016795 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7a402a19-422b-4c6d-8351-19db80617751 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:20.142961 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-574f1ec9-27c7-414f-88d1-67762cdbfc40 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:20.143704 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-574f1ec9-27c7-414f-88d1-67762cdbfc40 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:20.150982 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-574f1ec9-27c7-414f-88d1-67762cdbfc40 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:20.151683 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-574f1ec9-27c7-414f-88d1-67762cdbfc40 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:20.152671 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-574f1ec9-27c7-414f-88d1-67762cdbfc40 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:20.153284 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-574f1ec9-27c7-414f-88d1-67762cdbfc40 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:20.324895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7a402a19-422b-4c6d-8351-19db80617751 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:20.338697 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-574f1ec9-27c7-414f-88d1-67762cdbfc40 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:20.344048 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7a402a19-422b-4c6d-8351-19db80617751 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.340436 May 13 17:27:20.345977 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 59/120] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:19 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:20.354382 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-574f1ec9-27c7-414f-88d1-67762cdbfc40 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.215469 May 13 17:27:20.354926 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 62/121] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:20 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:20.491725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7c4c4069-3697-421d-b626-4c149b752ba5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:20.492481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7c4c4069-3697-421d-b626-4c149b752ba5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:20.505375 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7c4c4069-3697-421d-b626-4c149b752ba5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:20.505887 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7c4c4069-3697-421d-b626-4c149b752ba5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:20.506794 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7c4c4069-3697-421d-b626-4c149b752ba5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:20.507264 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7c4c4069-3697-421d-b626-4c149b752ba5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:20.820648 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d3c3fc11-bad9-40ed-941f-53b50b73a730 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:20.821278 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d3c3fc11-bad9-40ed-941f-53b50b73a730 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:20.827607 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d3c3fc11-bad9-40ed-941f-53b50b73a730 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:20.828079 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d3c3fc11-bad9-40ed-941f-53b50b73a730 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:20.828847 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d3c3fc11-bad9-40ed-941f-53b50b73a730 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:20.829314 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d3c3fc11-bad9-40ed-941f-53b50b73a730 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:20.848236 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7c4c4069-3697-421d-b626-4c149b752ba5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:20.856037 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7c4c4069-3697-421d-b626-4c149b752ba5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:20.857532 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7c4c4069-3697-421d-b626-4c149b752ba5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:20.859291 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7c4c4069-3697-421d-b626-4c149b752ba5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.373919 May 13 17:27:20.859855 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 60/122] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:20 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:20.980744 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d3c3fc11-bad9-40ed-941f-53b50b73a730 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:20.988889 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d3c3fc11-bad9-40ed-941f-53b50b73a730 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.172158 May 13 17:27:20.989473 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 63/123] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:20 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:27:21.362512 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-13e054af-f962-465e-8ea0-0223d45d1eaf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:21.364734 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-13e054af-f962-465e-8ea0-0223d45d1eaf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:21.371028 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-13e054af-f962-465e-8ea0-0223d45d1eaf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:21.371671 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-13e054af-f962-465e-8ea0-0223d45d1eaf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:21.372104 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b858c71e-1b86-4139-a292-53f3bf28c83c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:21.372632 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-13e054af-f962-465e-8ea0-0223d45d1eaf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:21.373065 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b858c71e-1b86-4139-a292-53f3bf28c83c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:21.373190 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-13e054af-f962-465e-8ea0-0223d45d1eaf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:21.379966 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b858c71e-1b86-4139-a292-53f3bf28c83c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:21.380654 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b858c71e-1b86-4139-a292-53f3bf28c83c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:21.387301 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b858c71e-1b86-4139-a292-53f3bf28c83c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:21.387301 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b858c71e-1b86-4139-a292-53f3bf28c83c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:21.538458 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b858c71e-1b86-4139-a292-53f3bf28c83c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:21.546593 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b858c71e-1b86-4139-a292-53f3bf28c83c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.178535 May 13 17:27:21.547318 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 64/124] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:21 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:21.727267 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-13e054af-f962-465e-8ea0-0223d45d1eaf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:21.736733 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-13e054af-f962-465e-8ea0-0223d45d1eaf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.378535 May 13 17:27:21.737882 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 61/125] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:21 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:21.879002 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b8a9b164-6543-4047-b75f-c5d2b7dae39d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:21.879641 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b8a9b164-6543-4047-b75f-c5d2b7dae39d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:21.897895 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b8a9b164-6543-4047-b75f-c5d2b7dae39d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:21.898353 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b8a9b164-6543-4047-b75f-c5d2b7dae39d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:21.899177 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b8a9b164-6543-4047-b75f-c5d2b7dae39d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:21.905089 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b8a9b164-6543-4047-b75f-c5d2b7dae39d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:22.007028 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-522e683b-b521-431f-8dc7-e68518c249fb tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:22.007677 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-522e683b-b521-431f-8dc7-e68518c249fb tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:22.013914 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-522e683b-b521-431f-8dc7-e68518c249fb tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:22.014388 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-522e683b-b521-431f-8dc7-e68518c249fb tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:22.015785 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-522e683b-b521-431f-8dc7-e68518c249fb tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:22.016220 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-522e683b-b521-431f-8dc7-e68518c249fb tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:22.054693 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b8a9b164-6543-4047-b75f-c5d2b7dae39d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:22.063994 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b8a9b164-6543-4047-b75f-c5d2b7dae39d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:22.069266 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b8a9b164-6543-4047-b75f-c5d2b7dae39d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:22.069266 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b8a9b164-6543-4047-b75f-c5d2b7dae39d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.191557 May 13 17:27:22.069266 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 65/126] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:21 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:22.164709 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-522e683b-b521-431f-8dc7-e68518c249fb tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:22.172445 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-522e683b-b521-431f-8dc7-e68518c249fb tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.170330 May 13 17:27:22.173000 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 62/127] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:22 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:27:22.563226 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f59c182d-2b46-4927-a42e-5236a7782e5e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:22.563851 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-f59c182d-2b46-4927-a42e-5236a7782e5e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:22.569686 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f59c182d-2b46-4927-a42e-5236a7782e5e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:22.570137 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f59c182d-2b46-4927-a42e-5236a7782e5e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:22.570902 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f59c182d-2b46-4927-a42e-5236a7782e5e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:22.571368 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f59c182d-2b46-4927-a42e-5236a7782e5e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:22.720231 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f59c182d-2b46-4927-a42e-5236a7782e5e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:22.728684 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f59c182d-2b46-4927-a42e-5236a7782e5e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.169212 May 13 17:27:22.729262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 66/128] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:22 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:22.753681 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1f667e26-befa-4ad4-8927-52c755fac22f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:22.758897 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1f667e26-befa-4ad4-8927-52c755fac22f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:22.760556 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1f667e26-befa-4ad4-8927-52c755fac22f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:22.761085 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1f667e26-befa-4ad4-8927-52c755fac22f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:22.761988 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1f667e26-befa-4ad4-8927-52c755fac22f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:22.762516 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1f667e26-befa-4ad4-8927-52c755fac22f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:22.939226 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1f667e26-befa-4ad4-8927-52c755fac22f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:22.948920 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1f667e26-befa-4ad4-8927-52c755fac22f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.198377 May 13 17:27:22.957266 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 63/129] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:22 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:23.009033 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-df56a7fb-504b-46d4-a46c-edcbc83db67a req-da4099e3-cc6b-4950-a8ca-396866e355cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebfc247d-ad6b-43f7-adec-b9054fefa3a1", "name": "network-vif-plugged", "status": "completed", "tag": "52e61d3c-72e9-427b-ac8a-8ad080ce50d0"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:27:23.022223 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-df56a7fb-504b-46d4-a46c-edcbc83db67a req-da4099e3-cc6b-4950-a8ca-396866e355cf service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:23.022842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-df56a7fb-504b-46d4-a46c-edcbc83db67a req-da4099e3-cc6b-4950-a8ca-396866e355cf service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:23.043002 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-df56a7fb-504b-46d4-a46c-edcbc83db67a req-da4099e3-cc6b-4950-a8ca-396866e355cf service nova] Creating event network-vif-plugged:52e61d3c-72e9-427b-ac8a-8ad080ce50d0 for instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 on hv-cinder-84178 May 13 17:27:23.043558 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-df56a7fb-504b-46d4-a46c-edcbc83db67a req-da4099e3-cc6b-4950-a8ca-396866e355cf service nova] Acquired lock "compute-rpcapi-router" {{(pid=117492) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 13 17:27:23.044664 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4e1fd1cd-788f-4553-8152-98877b668afc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:23.045094 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4e1fd1cd-788f-4553-8152-98877b668afc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:23.045926 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4e1fd1cd-788f-4553-8152-98877b668afc None None] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:23.046471 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4e1fd1cd-788f-4553-8152-98877b668afc None None] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:23.055335 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.compute.rpcapi [None req-4e1fd1cd-788f-4553-8152-98877b668afc None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 13 17:27:23.056252 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4e1fd1cd-788f-4553-8152-98877b668afc None None] Releasing lock "compute-rpcapi-router" {{(pid=117492) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 13 17:27:23.073877 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-4e1fd1cd-788f-4553-8152-98877b668afc None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218302 May 13 17:27:23.074471 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 67/130] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:27:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:27:23.084864 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-cec5d59e-2ceb-4880-a361-b5bae979f054 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:23.085705 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-cec5d59e-2ceb-4880-a361-b5bae979f054 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:23.092359 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cec5d59e-2ceb-4880-a361-b5bae979f054 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:23.093407 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cec5d59e-2ceb-4880-a361-b5bae979f054 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:23.094380 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cec5d59e-2ceb-4880-a361-b5bae979f054 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:23.094800 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cec5d59e-2ceb-4880-a361-b5bae979f054 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:23.189752 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-9d1ce931-ef53-4452-be94-61b5b0b1ad18 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:23.190452 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-9d1ce931-ef53-4452-be94-61b5b0b1ad18 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:23.196529 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9d1ce931-ef53-4452-be94-61b5b0b1ad18 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:23.196980 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9d1ce931-ef53-4452-be94-61b5b0b1ad18 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:23.197779 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9d1ce931-ef53-4452-be94-61b5b0b1ad18 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:23.198220 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9d1ce931-ef53-4452-be94-61b5b0b1ad18 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:23.225240 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-cec5d59e-2ceb-4880-a361-b5bae979f054 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:23.233610 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-cec5d59e-2ceb-4880-a361-b5bae979f054 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:23.234660 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-cec5d59e-2ceb-4880-a361-b5bae979f054 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:23.236204 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-cec5d59e-2ceb-4880-a361-b5bae979f054 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.154791 May 13 17:27:23.236351 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 64/131] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:23 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:23.333722 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-9d1ce931-ef53-4452-be94-61b5b0b1ad18 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:23.341699 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-9d1ce931-ef53-4452-be94-61b5b0b1ad18 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.156069 May 13 17:27:23.342276 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 68/132] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:23 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:27:23.745755 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-cee473d7-21dd-4196-b64c-b7b18f63e3d3 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:23.746368 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-cee473d7-21dd-4196-b64c-b7b18f63e3d3 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:23.753417 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cee473d7-21dd-4196-b64c-b7b18f63e3d3 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:23.753876 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cee473d7-21dd-4196-b64c-b7b18f63e3d3 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:23.754653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cee473d7-21dd-4196-b64c-b7b18f63e3d3 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:23.755098 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cee473d7-21dd-4196-b64c-b7b18f63e3d3 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:23.890075 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-cee473d7-21dd-4196-b64c-b7b18f63e3d3 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:23.897503 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-cee473d7-21dd-4196-b64c-b7b18f63e3d3 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.155637 May 13 17:27:23.898125 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 65/133] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:23 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:23.965746 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-4577bf86-8f4c-45aa-ab3e-7c9dda7124a8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:23.966356 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-4577bf86-8f4c-45aa-ab3e-7c9dda7124a8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:23.972430 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4577bf86-8f4c-45aa-ab3e-7c9dda7124a8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:23.972977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4577bf86-8f4c-45aa-ab3e-7c9dda7124a8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:23.973743 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4577bf86-8f4c-45aa-ab3e-7c9dda7124a8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:23.974183 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4577bf86-8f4c-45aa-ab3e-7c9dda7124a8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:24.103266 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-4577bf86-8f4c-45aa-ab3e-7c9dda7124a8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:24.111164 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-4577bf86-8f4c-45aa-ab3e-7c9dda7124a8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.149175 May 13 17:27:24.111738 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 69/134] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:23 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:24.253111 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-73de95c6-bd3f-44e8-9e86-b69799d995d6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:24.253715 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-73de95c6-bd3f-44e8-9e86-b69799d995d6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:24.259584 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-73de95c6-bd3f-44e8-9e86-b69799d995d6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:24.260034 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-73de95c6-bd3f-44e8-9e86-b69799d995d6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:24.260798 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-73de95c6-bd3f-44e8-9e86-b69799d995d6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:24.261285 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-73de95c6-bd3f-44e8-9e86-b69799d995d6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:24.358934 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-23341d57-40f0-4dfd-9f6b-f4338409fb08 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:24.359277 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-23341d57-40f0-4dfd-9f6b-f4338409fb08 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:24.365369 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-23341d57-40f0-4dfd-9f6b-f4338409fb08 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:24.365822 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-23341d57-40f0-4dfd-9f6b-f4338409fb08 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:24.366586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-23341d57-40f0-4dfd-9f6b-f4338409fb08 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:24.367207 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-23341d57-40f0-4dfd-9f6b-f4338409fb08 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:24.396944 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-73de95c6-bd3f-44e8-9e86-b69799d995d6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:24.404970 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-73de95c6-bd3f-44e8-9e86-b69799d995d6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:24.407050 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-73de95c6-bd3f-44e8-9e86-b69799d995d6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:24.408197 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-73de95c6-bd3f-44e8-9e86-b69799d995d6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.158884 May 13 17:27:24.409721 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 66/135] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:24 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:24.504266 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-23341d57-40f0-4dfd-9f6b-f4338409fb08 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:24.511436 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-23341d57-40f0-4dfd-9f6b-f4338409fb08 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.157188 May 13 17:27:24.512007 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 70/136] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:24 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:27:24.913617 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-495fb0ff-3702-4502-adec-be696c2910c7 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:24.914221 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-495fb0ff-3702-4502-adec-be696c2910c7 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:24.920332 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-495fb0ff-3702-4502-adec-be696c2910c7 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:24.921478 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-495fb0ff-3702-4502-adec-be696c2910c7 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:24.922239 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-495fb0ff-3702-4502-adec-be696c2910c7 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:24.922676 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-495fb0ff-3702-4502-adec-be696c2910c7 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:25.050142 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-495fb0ff-3702-4502-adec-be696c2910c7 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:25.057997 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-495fb0ff-3702-4502-adec-be696c2910c7 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.148195 May 13 17:27:25.058617 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 67/137] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:24 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:25.126687 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-e5867bc8-3b8a-442d-955d-ec9efbbaba51 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:25.127497 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-e5867bc8-3b8a-442d-955d-ec9efbbaba51 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:25.133282 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e5867bc8-3b8a-442d-955d-ec9efbbaba51 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:25.133736 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e5867bc8-3b8a-442d-955d-ec9efbbaba51 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:25.134490 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e5867bc8-3b8a-442d-955d-ec9efbbaba51 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:25.134927 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e5867bc8-3b8a-442d-955d-ec9efbbaba51 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:25.261951 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-e5867bc8-3b8a-442d-955d-ec9efbbaba51 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:25.269715 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-e5867bc8-3b8a-442d-955d-ec9efbbaba51 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.146853 May 13 17:27:25.270274 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 71/138] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:25 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:27:25.425606 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8ae097bd-0ff9-46e6-b131-63abe03a959e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:25.426270 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8ae097bd-0ff9-46e6-b131-63abe03a959e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:25.432106 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8ae097bd-0ff9-46e6-b131-63abe03a959e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:25.432561 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8ae097bd-0ff9-46e6-b131-63abe03a959e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:25.433319 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8ae097bd-0ff9-46e6-b131-63abe03a959e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:25.433884 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8ae097bd-0ff9-46e6-b131-63abe03a959e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:25.528970 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-251d9e1c-b189-47b6-804f-e5894709ffe3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:25.529647 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-251d9e1c-b189-47b6-804f-e5894709ffe3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:25.536473 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-251d9e1c-b189-47b6-804f-e5894709ffe3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:25.537029 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-251d9e1c-b189-47b6-804f-e5894709ffe3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:25.537923 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-251d9e1c-b189-47b6-804f-e5894709ffe3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:25.538647 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-251d9e1c-b189-47b6-804f-e5894709ffe3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:25.567014 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8ae097bd-0ff9-46e6-b131-63abe03a959e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:25.575052 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8ae097bd-0ff9-46e6-b131-63abe03a959e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:25.576612 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8ae097bd-0ff9-46e6-b131-63abe03a959e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:25.578362 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8ae097bd-0ff9-46e6-b131-63abe03a959e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.156630 May 13 17:27:25.578965 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 68/139] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:25 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:25.673470 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-251d9e1c-b189-47b6-804f-e5894709ffe3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:25.680547 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-251d9e1c-b189-47b6-804f-e5894709ffe3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.155589 May 13 17:27:25.681107 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 72/140] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:25 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:26.074636 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ae3280e7-cdd8-4f55-a6e6-3cb87c1b5031 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:26.075271 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ae3280e7-cdd8-4f55-a6e6-3cb87c1b5031 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:26.081333 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ae3280e7-cdd8-4f55-a6e6-3cb87c1b5031 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:26.081733 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ae3280e7-cdd8-4f55-a6e6-3cb87c1b5031 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:26.082495 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ae3280e7-cdd8-4f55-a6e6-3cb87c1b5031 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:26.082936 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ae3280e7-cdd8-4f55-a6e6-3cb87c1b5031 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:26.208718 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ae3280e7-cdd8-4f55-a6e6-3cb87c1b5031 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:26.216043 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ae3280e7-cdd8-4f55-a6e6-3cb87c1b5031 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.145194 May 13 17:27:26.216610 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 69/141] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:26 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:26.286597 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3152c6fd-7f80-433a-8447-5a03e73f796f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:26.287235 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3152c6fd-7f80-433a-8447-5a03e73f796f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:26.293048 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3152c6fd-7f80-433a-8447-5a03e73f796f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:26.293495 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3152c6fd-7f80-433a-8447-5a03e73f796f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:26.294260 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3152c6fd-7f80-433a-8447-5a03e73f796f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:26.294699 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3152c6fd-7f80-433a-8447-5a03e73f796f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:26.421802 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3152c6fd-7f80-433a-8447-5a03e73f796f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:26.428963 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3152c6fd-7f80-433a-8447-5a03e73f796f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.146127 May 13 17:27:26.429538 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 73/142] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:26 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:26.596909 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-322a9df5-4357-4a8b-a2d8-79ecb34413ec tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:26.597513 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-322a9df5-4357-4a8b-a2d8-79ecb34413ec tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:26.603399 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-322a9df5-4357-4a8b-a2d8-79ecb34413ec tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:26.603847 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-322a9df5-4357-4a8b-a2d8-79ecb34413ec tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:26.604631 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-322a9df5-4357-4a8b-a2d8-79ecb34413ec tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:26.605064 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-322a9df5-4357-4a8b-a2d8-79ecb34413ec tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:26.697702 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-9bdf1bf4-fb40-4463-a052-2d7016b48ea1 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:26.704689 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-9bdf1bf4-fb40-4463-a052-2d7016b48ea1 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:26.704810 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9bdf1bf4-fb40-4463-a052-2d7016b48ea1 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:26.705191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9bdf1bf4-fb40-4463-a052-2d7016b48ea1 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:26.705957 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9bdf1bf4-fb40-4463-a052-2d7016b48ea1 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:26.706389 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9bdf1bf4-fb40-4463-a052-2d7016b48ea1 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:26.736683 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-322a9df5-4357-4a8b-a2d8-79ecb34413ec tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:26.745352 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-322a9df5-4357-4a8b-a2d8-79ecb34413ec tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:26.747054 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-322a9df5-4357-4a8b-a2d8-79ecb34413ec tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:26.750748 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-322a9df5-4357-4a8b-a2d8-79ecb34413ec tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.156044 May 13 17:27:26.751393 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 70/143] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:26 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:26.850957 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-9bdf1bf4-fb40-4463-a052-2d7016b48ea1 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:26.858117 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-9bdf1bf4-fb40-4463-a052-2d7016b48ea1 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.164260 May 13 17:27:26.858690 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 74/144] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:26 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:27:27.232982 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ca07ba90-66bd-40d7-bf3f-a096fec8ff00 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:27.233585 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ca07ba90-66bd-40d7-bf3f-a096fec8ff00 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:27.239320 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ca07ba90-66bd-40d7-bf3f-a096fec8ff00 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:27.239772 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ca07ba90-66bd-40d7-bf3f-a096fec8ff00 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:27.240587 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ca07ba90-66bd-40d7-bf3f-a096fec8ff00 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:27.241021 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ca07ba90-66bd-40d7-bf3f-a096fec8ff00 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:27.365476 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ca07ba90-66bd-40d7-bf3f-a096fec8ff00 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:27.372631 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ca07ba90-66bd-40d7-bf3f-a096fec8ff00 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.143456 May 13 17:27:27.373191 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 71/145] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:27 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:27.446465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-43d61e94-b202-4dd2-8cd6-349becb36e1d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:27.446465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-43d61e94-b202-4dd2-8cd6-349becb36e1d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:27.452285 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-43d61e94-b202-4dd2-8cd6-349becb36e1d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:27.452784 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-43d61e94-b202-4dd2-8cd6-349becb36e1d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:27.453578 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-43d61e94-b202-4dd2-8cd6-349becb36e1d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:27.454017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-43d61e94-b202-4dd2-8cd6-349becb36e1d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:27.588374 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-43d61e94-b202-4dd2-8cd6-349becb36e1d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:27.596138 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-43d61e94-b202-4dd2-8cd6-349becb36e1d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.154703 May 13 17:27:27.596713 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 75/146] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:27 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:27.768181 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0a828d06-f398-4586-9153-4b5397ab34cd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:27.768778 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0a828d06-f398-4586-9153-4b5397ab34cd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:27.774429 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0a828d06-f398-4586-9153-4b5397ab34cd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:27.774875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0a828d06-f398-4586-9153-4b5397ab34cd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:27.775693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0a828d06-f398-4586-9153-4b5397ab34cd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:27.776126 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0a828d06-f398-4586-9153-4b5397ab34cd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:27.874470 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-2044deca-88a0-4de0-8868-78f1421e97f7 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:27.875106 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-2044deca-88a0-4de0-8868-78f1421e97f7 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:27.881749 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2044deca-88a0-4de0-8868-78f1421e97f7 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:27.882202 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2044deca-88a0-4de0-8868-78f1421e97f7 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:27.882968 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2044deca-88a0-4de0-8868-78f1421e97f7 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:27.883424 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2044deca-88a0-4de0-8868-78f1421e97f7 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:27.914754 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0a828d06-f398-4586-9153-4b5397ab34cd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:27.923434 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0a828d06-f398-4586-9153-4b5397ab34cd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:27.925139 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0a828d06-f398-4586-9153-4b5397ab34cd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:27.926262 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0a828d06-f398-4586-9153-4b5397ab34cd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.161870 May 13 17:27:27.926821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 72/147] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:27 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:28.025972 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-2044deca-88a0-4de0-8868-78f1421e97f7 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:28.034195 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-2044deca-88a0-4de0-8868-78f1421e97f7 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.163556 May 13 17:27:28.034771 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 76/148] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:27 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:27:28.389848 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d2c8a473-fa6c-4782-80aa-3f47d03202ee tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:28.390453 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d2c8a473-fa6c-4782-80aa-3f47d03202ee tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:28.396888 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d2c8a473-fa6c-4782-80aa-3f47d03202ee tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:28.397329 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d2c8a473-fa6c-4782-80aa-3f47d03202ee tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:28.398078 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d2c8a473-fa6c-4782-80aa-3f47d03202ee tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:28.398507 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d2c8a473-fa6c-4782-80aa-3f47d03202ee tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:28.530089 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d2c8a473-fa6c-4782-80aa-3f47d03202ee tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:28.537377 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d2c8a473-fa6c-4782-80aa-3f47d03202ee tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.151392 May 13 17:27:28.537926 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 73/149] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:28 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:28.612226 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-bf421f3d-0ade-44bc-988f-7a1f6e3cb970 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:28.612884 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-bf421f3d-0ade-44bc-988f-7a1f6e3cb970 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:28.618823 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bf421f3d-0ade-44bc-988f-7a1f6e3cb970 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:28.619302 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bf421f3d-0ade-44bc-988f-7a1f6e3cb970 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:28.620060 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bf421f3d-0ade-44bc-988f-7a1f6e3cb970 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:28.620532 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bf421f3d-0ade-44bc-988f-7a1f6e3cb970 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:28.746315 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-bf421f3d-0ade-44bc-988f-7a1f6e3cb970 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:28.754167 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-bf421f3d-0ade-44bc-988f-7a1f6e3cb970 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.145798 May 13 17:27:28.754738 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 77/150] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:28 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:28.947282 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ac191501-5b7e-46ed-9819-bb0846781d9a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:28.947807 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ac191501-5b7e-46ed-9819-bb0846781d9a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:28.954176 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ac191501-5b7e-46ed-9819-bb0846781d9a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:28.954616 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ac191501-5b7e-46ed-9819-bb0846781d9a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:28.955395 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ac191501-5b7e-46ed-9819-bb0846781d9a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:28.955826 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ac191501-5b7e-46ed-9819-bb0846781d9a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:29.050774 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-dedc3c84-f890-41b0-a7d4-cf8cd8a435e7 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:29.051416 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-dedc3c84-f890-41b0-a7d4-cf8cd8a435e7 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:29.059505 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dedc3c84-f890-41b0-a7d4-cf8cd8a435e7 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:29.059725 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dedc3c84-f890-41b0-a7d4-cf8cd8a435e7 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:29.060535 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dedc3c84-f890-41b0-a7d4-cf8cd8a435e7 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:29.060920 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dedc3c84-f890-41b0-a7d4-cf8cd8a435e7 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:29.108693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ac191501-5b7e-46ed-9819-bb0846781d9a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:29.124280 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ac191501-5b7e-46ed-9819-bb0846781d9a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:29.125998 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ac191501-5b7e-46ed-9819-bb0846781d9a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:29.127283 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ac191501-5b7e-46ed-9819-bb0846781d9a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.183937 May 13 17:27:29.127784 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 74/151] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:28 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:29.234225 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-dedc3c84-f890-41b0-a7d4-cf8cd8a435e7 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:29.243465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-dedc3c84-f890-41b0-a7d4-cf8cd8a435e7 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.196194 May 13 17:27:29.244156 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 78/152] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:29 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:29.554324 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-eb37bddf-5977-458e-bc7f-fc05bd030a86 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:29.554836 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-eb37bddf-5977-458e-bc7f-fc05bd030a86 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:29.560529 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eb37bddf-5977-458e-bc7f-fc05bd030a86 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:29.560977 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eb37bddf-5977-458e-bc7f-fc05bd030a86 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:29.561733 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eb37bddf-5977-458e-bc7f-fc05bd030a86 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:29.562168 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eb37bddf-5977-458e-bc7f-fc05bd030a86 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:29.690480 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-eb37bddf-5977-458e-bc7f-fc05bd030a86 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:29.697618 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-eb37bddf-5977-458e-bc7f-fc05bd030a86 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.147237 May 13 17:27:29.698209 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 75/153] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:29 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:29.771315 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d38f1cf2-3198-486a-99da-304ae2f48602 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:29.773559 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d38f1cf2-3198-486a-99da-304ae2f48602 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:29.777914 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d38f1cf2-3198-486a-99da-304ae2f48602 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:29.778526 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d38f1cf2-3198-486a-99da-304ae2f48602 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:29.779311 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d38f1cf2-3198-486a-99da-304ae2f48602 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:29.779744 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d38f1cf2-3198-486a-99da-304ae2f48602 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:29.904095 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d38f1cf2-3198-486a-99da-304ae2f48602 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:29.911984 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d38f1cf2-3198-486a-99da-304ae2f48602 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.144505 May 13 17:27:29.912546 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 79/154] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:29 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:30.145415 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b9fdb399-aff4-4ec0-b81c-5e55b9e50a87 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:30.146009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b9fdb399-aff4-4ec0-b81c-5e55b9e50a87 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:30.151932 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b9fdb399-aff4-4ec0-b81c-5e55b9e50a87 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:30.152386 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b9fdb399-aff4-4ec0-b81c-5e55b9e50a87 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:30.153230 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b9fdb399-aff4-4ec0-b81c-5e55b9e50a87 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:30.153662 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b9fdb399-aff4-4ec0-b81c-5e55b9e50a87 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:30.268963 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-46164312-c44d-43e8-a6ef-d91c3a83689b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:30.269599 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-46164312-c44d-43e8-a6ef-d91c3a83689b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:30.275407 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-46164312-c44d-43e8-a6ef-d91c3a83689b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:30.275857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-46164312-c44d-43e8-a6ef-d91c3a83689b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:30.276620 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-46164312-c44d-43e8-a6ef-d91c3a83689b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:30.277050 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-46164312-c44d-43e8-a6ef-d91c3a83689b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:30.291151 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b9fdb399-aff4-4ec0-b81c-5e55b9e50a87 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:30.301220 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b9fdb399-aff4-4ec0-b81c-5e55b9e50a87 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:30.302906 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b9fdb399-aff4-4ec0-b81c-5e55b9e50a87 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:30.304294 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b9fdb399-aff4-4ec0-b81c-5e55b9e50a87 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.163184 May 13 17:27:30.304965 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 76/155] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:30 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:30.416529 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-46164312-c44d-43e8-a6ef-d91c3a83689b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:30.423809 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-46164312-c44d-43e8-a6ef-d91c3a83689b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.158576 May 13 17:27:30.424555 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 80/156] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:30 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:27:30.714880 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-562cc41e-cbcd-49c5-b6b6-aa2e00c5a0ca tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:30.715552 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-562cc41e-cbcd-49c5-b6b6-aa2e00c5a0ca tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:30.722344 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-562cc41e-cbcd-49c5-b6b6-aa2e00c5a0ca tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:30.722813 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-562cc41e-cbcd-49c5-b6b6-aa2e00c5a0ca tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:30.723654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-562cc41e-cbcd-49c5-b6b6-aa2e00c5a0ca tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:30.724120 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-562cc41e-cbcd-49c5-b6b6-aa2e00c5a0ca tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:30.851447 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-562cc41e-cbcd-49c5-b6b6-aa2e00c5a0ca tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:30.861556 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-562cc41e-cbcd-49c5-b6b6-aa2e00c5a0ca tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.148871 May 13 17:27:30.862961 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 77/157] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:30 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:30.929236 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7dd0017e-e69f-4704-9247-bbf3f7823410 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:30.929829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7dd0017e-e69f-4704-9247-bbf3f7823410 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:30.935805 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7dd0017e-e69f-4704-9247-bbf3f7823410 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:30.936242 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7dd0017e-e69f-4704-9247-bbf3f7823410 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:30.937092 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7dd0017e-e69f-4704-9247-bbf3f7823410 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:30.937520 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7dd0017e-e69f-4704-9247-bbf3f7823410 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:31.066392 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7dd0017e-e69f-4704-9247-bbf3f7823410 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:31.073779 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7dd0017e-e69f-4704-9247-bbf3f7823410 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.148399 May 13 17:27:31.074347 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 81/158] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:30 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:31.321843 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-481ff762-aef0-4f54-af3b-ea567844c5dc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:31.322448 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-481ff762-aef0-4f54-af3b-ea567844c5dc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:31.328951 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-481ff762-aef0-4f54-af3b-ea567844c5dc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:31.329402 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-481ff762-aef0-4f54-af3b-ea567844c5dc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:31.330167 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-481ff762-aef0-4f54-af3b-ea567844c5dc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:31.330599 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-481ff762-aef0-4f54-af3b-ea567844c5dc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:31.443860 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-ab3e0ab1-924d-4906-a540-e8f548ad77ee tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:31.443860 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-ab3e0ab1-924d-4906-a540-e8f548ad77ee tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:31.450277 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ab3e0ab1-924d-4906-a540-e8f548ad77ee tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:31.451032 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ab3e0ab1-924d-4906-a540-e8f548ad77ee tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:31.452177 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ab3e0ab1-924d-4906-a540-e8f548ad77ee tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:31.452941 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ab3e0ab1-924d-4906-a540-e8f548ad77ee tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:31.482560 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-481ff762-aef0-4f54-af3b-ea567844c5dc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:31.490629 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-481ff762-aef0-4f54-af3b-ea567844c5dc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:31.492159 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-481ff762-aef0-4f54-af3b-ea567844c5dc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:31.493271 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-481ff762-aef0-4f54-af3b-ea567844c5dc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.175366 May 13 17:27:31.494536 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 78/159] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:31 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:31.604934 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-ab3e0ab1-924d-4906-a540-e8f548ad77ee tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:31.612294 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-ab3e0ab1-924d-4906-a540-e8f548ad77ee tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.175142 May 13 17:27:31.612873 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 82/160] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:31 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:31.879628 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-64fa9647-4a31-44ef-aab2-6a7ced05b0ff tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:31.880235 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-64fa9647-4a31-44ef-aab2-6a7ced05b0ff tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:31.891853 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-64fa9647-4a31-44ef-aab2-6a7ced05b0ff tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:31.892657 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-64fa9647-4a31-44ef-aab2-6a7ced05b0ff tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:31.893034 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-64fa9647-4a31-44ef-aab2-6a7ced05b0ff tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:31.893699 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-64fa9647-4a31-44ef-aab2-6a7ced05b0ff tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:32.030026 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-64fa9647-4a31-44ef-aab2-6a7ced05b0ff tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:32.037869 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-64fa9647-4a31-44ef-aab2-6a7ced05b0ff tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.162058 May 13 17:27:32.038426 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 79/161] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:31 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:27:32.089905 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d6373417-9b8a-4904-acba-5a29bf43384d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:32.090521 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d6373417-9b8a-4904-acba-5a29bf43384d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:32.098623 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d6373417-9b8a-4904-acba-5a29bf43384d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:32.101357 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d6373417-9b8a-4904-acba-5a29bf43384d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:32.101357 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d6373417-9b8a-4904-acba-5a29bf43384d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:32.101357 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d6373417-9b8a-4904-acba-5a29bf43384d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:32.229742 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d6373417-9b8a-4904-acba-5a29bf43384d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:32.237297 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d6373417-9b8a-4904-acba-5a29bf43384d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.151259 May 13 17:27:32.237864 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 83/162] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:32 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:32.513108 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9c906eed-86c8-4442-9e0a-368904c8c395 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:32.513868 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9c906eed-86c8-4442-9e0a-368904c8c395 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:32.520730 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9c906eed-86c8-4442-9e0a-368904c8c395 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:32.521187 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9c906eed-86c8-4442-9e0a-368904c8c395 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:32.530614 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9c906eed-86c8-4442-9e0a-368904c8c395 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:32.531187 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9c906eed-86c8-4442-9e0a-368904c8c395 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:32.631013 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-77fbc360-11e5-4cfe-a34f-b794ddc677cd tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:32.631724 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-77fbc360-11e5-4cfe-a34f-b794ddc677cd tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:32.637953 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-77fbc360-11e5-4cfe-a34f-b794ddc677cd tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:32.638408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-77fbc360-11e5-4cfe-a34f-b794ddc677cd tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:32.639368 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-77fbc360-11e5-4cfe-a34f-b794ddc677cd tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:32.639801 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-77fbc360-11e5-4cfe-a34f-b794ddc677cd tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:32.785839 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-77fbc360-11e5-4cfe-a34f-b794ddc677cd tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:32.795056 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-77fbc360-11e5-4cfe-a34f-b794ddc677cd tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.169400 May 13 17:27:32.801611 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 84/163] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:32 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:27:32.863120 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9c906eed-86c8-4442-9e0a-368904c8c395 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:32.871113 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9c906eed-86c8-4442-9e0a-368904c8c395 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:32.872615 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9c906eed-86c8-4442-9e0a-368904c8c395 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:32.873714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9c906eed-86c8-4442-9e0a-368904c8c395 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.364895 May 13 17:27:32.874272 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 80/164] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:32 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:33.054044 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-2b37e5bd-bab3-4d07-a04e-2e5d9f952de8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:33.054654 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-2b37e5bd-bab3-4d07-a04e-2e5d9f952de8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:33.060460 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2b37e5bd-bab3-4d07-a04e-2e5d9f952de8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:33.060906 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2b37e5bd-bab3-4d07-a04e-2e5d9f952de8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:33.061772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2b37e5bd-bab3-4d07-a04e-2e5d9f952de8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:33.062225 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2b37e5bd-bab3-4d07-a04e-2e5d9f952de8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:33.190090 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-2b37e5bd-bab3-4d07-a04e-2e5d9f952de8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:33.197388 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-2b37e5bd-bab3-4d07-a04e-2e5d9f952de8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.147287 May 13 17:27:33.197954 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 85/165] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:33 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:33.254451 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-436878c3-18b3-4150-b913-d90890aa655e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:33.254970 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-436878c3-18b3-4150-b913-d90890aa655e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:33.260955 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-436878c3-18b3-4150-b913-d90890aa655e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:33.261403 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-436878c3-18b3-4150-b913-d90890aa655e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:33.262159 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-436878c3-18b3-4150-b913-d90890aa655e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:33.262594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-436878c3-18b3-4150-b913-d90890aa655e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:33.427398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-436878c3-18b3-4150-b913-d90890aa655e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:33.434676 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-436878c3-18b3-4150-b913-d90890aa655e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.184719 May 13 17:27:33.435261 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 81/166] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:33 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:33.814544 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-26d06de0-1d94-4181-b911-cdb21563fb00 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:33.816117 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-26d06de0-1d94-4181-b911-cdb21563fb00 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:33.824087 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-26d06de0-1d94-4181-b911-cdb21563fb00 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:33.824772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-26d06de0-1d94-4181-b911-cdb21563fb00 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:33.825865 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-26d06de0-1d94-4181-b911-cdb21563fb00 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:33.826598 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-26d06de0-1d94-4181-b911-cdb21563fb00 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:33.893399 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b47d7d1d-777f-484b-be1d-3f89dfa7ae9f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:33.894066 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b47d7d1d-777f-484b-be1d-3f89dfa7ae9f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:33.902029 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b47d7d1d-777f-484b-be1d-3f89dfa7ae9f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:33.902760 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b47d7d1d-777f-484b-be1d-3f89dfa7ae9f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:33.903853 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b47d7d1d-777f-484b-be1d-3f89dfa7ae9f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:33.904337 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b47d7d1d-777f-484b-be1d-3f89dfa7ae9f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:34.012807 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-26d06de0-1d94-4181-b911-cdb21563fb00 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:34.021888 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-26d06de0-1d94-4181-b911-cdb21563fb00 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.213525 May 13 17:27:34.022449 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 86/167] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:33 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:34.065860 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b47d7d1d-777f-484b-be1d-3f89dfa7ae9f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:34.073786 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b47d7d1d-777f-484b-be1d-3f89dfa7ae9f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:34.075388 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b47d7d1d-777f-484b-be1d-3f89dfa7ae9f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:34.076492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b47d7d1d-777f-484b-be1d-3f89dfa7ae9f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.188479 May 13 17:27:34.079162 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 82/168] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:33 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:27:34.215327 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-c3a34683-7474-49fe-a339-1d7d351e345e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:34.215949 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-c3a34683-7474-49fe-a339-1d7d351e345e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:34.222464 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c3a34683-7474-49fe-a339-1d7d351e345e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:34.222911 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c3a34683-7474-49fe-a339-1d7d351e345e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:34.224267 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c3a34683-7474-49fe-a339-1d7d351e345e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:34.224267 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c3a34683-7474-49fe-a339-1d7d351e345e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:34.352072 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c3a34683-7474-49fe-a339-1d7d351e345e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:34.360249 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-c3a34683-7474-49fe-a339-1d7d351e345e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.148748 May 13 17:27:34.360899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 87/169] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:34 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:34.451614 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ccd10d4b-6711-4d98-bbd9-bf600e5e054d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:34.452227 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ccd10d4b-6711-4d98-bbd9-bf600e5e054d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:34.458295 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ccd10d4b-6711-4d98-bbd9-bf600e5e054d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:34.469323 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ccd10d4b-6711-4d98-bbd9-bf600e5e054d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:34.469323 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ccd10d4b-6711-4d98-bbd9-bf600e5e054d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:34.469323 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ccd10d4b-6711-4d98-bbd9-bf600e5e054d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:34.596115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ccd10d4b-6711-4d98-bbd9-bf600e5e054d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:34.603794 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ccd10d4b-6711-4d98-bbd9-bf600e5e054d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.155893 May 13 17:27:34.604373 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 83/170] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:34 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:35.038750 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3c584053-9187-43db-ac4d-f92e5263a939 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:35.039411 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3c584053-9187-43db-ac4d-f92e5263a939 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:35.045249 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3c584053-9187-43db-ac4d-f92e5263a939 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:35.045717 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3c584053-9187-43db-ac4d-f92e5263a939 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:35.046461 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3c584053-9187-43db-ac4d-f92e5263a939 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:35.046900 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3c584053-9187-43db-ac4d-f92e5263a939 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:35.095685 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f13ce8a0-c446-45ca-9ecc-9c4acb73358d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:35.096332 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f13ce8a0-c446-45ca-9ecc-9c4acb73358d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:35.102080 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f13ce8a0-c446-45ca-9ecc-9c4acb73358d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:35.102531 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f13ce8a0-c446-45ca-9ecc-9c4acb73358d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:35.103343 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f13ce8a0-c446-45ca-9ecc-9c4acb73358d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:35.103783 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f13ce8a0-c446-45ca-9ecc-9c4acb73358d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:35.176929 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3c584053-9187-43db-ac4d-f92e5263a939 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:35.184484 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3c584053-9187-43db-ac4d-f92e5263a939 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.149760 May 13 17:27:35.185051 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 88/171] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:35 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:35.229519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f13ce8a0-c446-45ca-9ecc-9c4acb73358d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:35.237257 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f13ce8a0-c446-45ca-9ecc-9c4acb73358d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:35.238763 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f13ce8a0-c446-45ca-9ecc-9c4acb73358d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:35.239953 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f13ce8a0-c446-45ca-9ecc-9c4acb73358d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.148995 May 13 17:27:35.240518 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 84/172] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:35 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:27:35.377362 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-73b25889-e281-4d6d-b766-3f9ae8141dd8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:35.377964 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-73b25889-e281-4d6d-b766-3f9ae8141dd8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:35.383763 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-73b25889-e281-4d6d-b766-3f9ae8141dd8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:35.384206 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-73b25889-e281-4d6d-b766-3f9ae8141dd8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:35.384954 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-73b25889-e281-4d6d-b766-3f9ae8141dd8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:35.385381 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-73b25889-e281-4d6d-b766-3f9ae8141dd8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:35.508090 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-73b25889-e281-4d6d-b766-3f9ae8141dd8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:35.515071 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-73b25889-e281-4d6d-b766-3f9ae8141dd8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.141485 May 13 17:27:35.515660 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 89/173] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:35 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:35.620937 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-61c5c5cc-becc-4bc2-9370-ed15557f213c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:35.622222 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-61c5c5cc-becc-4bc2-9370-ed15557f213c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:35.628198 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61c5c5cc-becc-4bc2-9370-ed15557f213c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:35.628646 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61c5c5cc-becc-4bc2-9370-ed15557f213c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:35.629405 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61c5c5cc-becc-4bc2-9370-ed15557f213c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:35.629837 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61c5c5cc-becc-4bc2-9370-ed15557f213c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:35.751252 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-61c5c5cc-becc-4bc2-9370-ed15557f213c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:35.758342 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-61c5c5cc-becc-4bc2-9370-ed15557f213c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.141237 May 13 17:27:35.758899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 85/174] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:35 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:36.201490 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-fe9e9d1c-fb5b-4e44-9ce5-c5c9ecf8c76b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:36.202221 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-fe9e9d1c-fb5b-4e44-9ce5-c5c9ecf8c76b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:36.204429 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-d2bc56bc-554d-40e2-8dd8-def33c5e318a req-62b2b625-7b12-460e-9591-e2a27858ad31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "271501e4-dcad-4de1-92a7-8ad28c0dc5e0", "name": "network-vif-plugged", "status": "completed", "tag": "6c67b852-5901-4a54-9821-0cbca68ceaca"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:27:36.208408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fe9e9d1c-fb5b-4e44-9ce5-c5c9ecf8c76b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:36.208859 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fe9e9d1c-fb5b-4e44-9ce5-c5c9ecf8c76b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:36.209632 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fe9e9d1c-fb5b-4e44-9ce5-c5c9ecf8c76b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:36.210241 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fe9e9d1c-fb5b-4e44-9ce5-c5c9ecf8c76b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:36.212816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-d2bc56bc-554d-40e2-8dd8-def33c5e318a req-62b2b625-7b12-460e-9591-e2a27858ad31 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:36.213261 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-d2bc56bc-554d-40e2-8dd8-def33c5e318a req-62b2b625-7b12-460e-9591-e2a27858ad31 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:36.225020 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-d2bc56bc-554d-40e2-8dd8-def33c5e318a req-62b2b625-7b12-460e-9591-e2a27858ad31 service nova] Creating event network-vif-plugged:6c67b852-5901-4a54-9821-0cbca68ceaca for instance 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 on hv-cinder-84178 May 13 17:27:36.230028 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-d2bc56bc-554d-40e2-8dd8-def33c5e318a req-62b2b625-7b12-460e-9591-e2a27858ad31 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030059 May 13 17:27:36.230615 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 86/175] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:27:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:27:36.258718 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9c4de4fb-c488-434a-a637-e0cf042144c1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:36.259440 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9c4de4fb-c488-434a-a637-e0cf042144c1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:36.265574 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9c4de4fb-c488-434a-a637-e0cf042144c1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:36.266022 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9c4de4fb-c488-434a-a637-e0cf042144c1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:36.266778 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9c4de4fb-c488-434a-a637-e0cf042144c1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:36.267246 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9c4de4fb-c488-434a-a637-e0cf042144c1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:36.347703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-fe9e9d1c-fb5b-4e44-9ce5-c5c9ecf8c76b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:36.357035 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-fe9e9d1c-fb5b-4e44-9ce5-c5c9ecf8c76b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.159683 May 13 17:27:36.366871 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 90/176] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:36 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:36.406999 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9c4de4fb-c488-434a-a637-e0cf042144c1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:36.414942 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9c4de4fb-c488-434a-a637-e0cf042144c1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:36.419311 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9c4de4fb-c488-434a-a637-e0cf042144c1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:36.419311 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9c4de4fb-c488-434a-a637-e0cf042144c1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.163188 May 13 17:27:36.419311 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 87/177] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:36 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:27:36.532401 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b63ebe55-58c3-4218-96f0-55d061740d66 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:36.532957 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b63ebe55-58c3-4218-96f0-55d061740d66 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:36.538834 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b63ebe55-58c3-4218-96f0-55d061740d66 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:36.539318 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b63ebe55-58c3-4218-96f0-55d061740d66 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:36.540085 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b63ebe55-58c3-4218-96f0-55d061740d66 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:36.540517 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b63ebe55-58c3-4218-96f0-55d061740d66 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:36.662556 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b63ebe55-58c3-4218-96f0-55d061740d66 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:36.669690 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b63ebe55-58c3-4218-96f0-55d061740d66 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.141862 May 13 17:27:36.670253 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 91/178] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:36 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:36.774936 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a6fd9e38-ff81-44b5-b549-fda2d2dd7793 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:36.775564 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a6fd9e38-ff81-44b5-b549-fda2d2dd7793 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:36.781475 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a6fd9e38-ff81-44b5-b549-fda2d2dd7793 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:36.781922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a6fd9e38-ff81-44b5-b549-fda2d2dd7793 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:36.782723 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a6fd9e38-ff81-44b5-b549-fda2d2dd7793 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:36.783108 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a6fd9e38-ff81-44b5-b549-fda2d2dd7793 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:36.906887 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a6fd9e38-ff81-44b5-b549-fda2d2dd7793 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:36.914569 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a6fd9e38-ff81-44b5-b549-fda2d2dd7793 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.143365 May 13 17:27:36.915384 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 88/179] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:36 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:37.374347 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6892d9a4-6926-4fdf-ac3e-3f35dcf378bf tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:37.374954 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6892d9a4-6926-4fdf-ac3e-3f35dcf378bf tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:37.380883 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6892d9a4-6926-4fdf-ac3e-3f35dcf378bf tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:37.381333 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6892d9a4-6926-4fdf-ac3e-3f35dcf378bf tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:37.382095 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6892d9a4-6926-4fdf-ac3e-3f35dcf378bf tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:37.382532 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6892d9a4-6926-4fdf-ac3e-3f35dcf378bf tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:37.435964 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6a3e0a4b-a6c8-4a02-aa7b-072011d2f370 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:37.436786 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6a3e0a4b-a6c8-4a02-aa7b-072011d2f370 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:37.443411 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6a3e0a4b-a6c8-4a02-aa7b-072011d2f370 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:37.443942 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6a3e0a4b-a6c8-4a02-aa7b-072011d2f370 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:37.444853 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6a3e0a4b-a6c8-4a02-aa7b-072011d2f370 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:37.445384 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6a3e0a4b-a6c8-4a02-aa7b-072011d2f370 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:37.510345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6892d9a4-6926-4fdf-ac3e-3f35dcf378bf tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:37.518208 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6892d9a4-6926-4fdf-ac3e-3f35dcf378bf tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.147084 May 13 17:27:37.518779 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 92/180] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:37 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:37.582524 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6a3e0a4b-a6c8-4a02-aa7b-072011d2f370 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:37.590108 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6a3e0a4b-a6c8-4a02-aa7b-072011d2f370 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:37.591613 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6a3e0a4b-a6c8-4a02-aa7b-072011d2f370 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:37.592698 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6a3e0a4b-a6c8-4a02-aa7b-072011d2f370 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.161089 May 13 17:27:37.593518 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 89/181] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:37 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:27:37.685591 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-83868061-e850-40ab-821c-9b48c853038d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:37.686196 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-83868061-e850-40ab-821c-9b48c853038d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:37.692616 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-83868061-e850-40ab-821c-9b48c853038d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:37.693063 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-83868061-e850-40ab-821c-9b48c853038d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:37.693826 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-83868061-e850-40ab-821c-9b48c853038d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:37.694262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-83868061-e850-40ab-821c-9b48c853038d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:37.834104 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-83868061-e850-40ab-821c-9b48c853038d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:37.841242 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-83868061-e850-40ab-821c-9b48c853038d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.159493 May 13 17:27:37.841809 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 93/182] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:37 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:37.939146 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-bad1eb77-5658-49f5-8611-a3252fc87d15 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:37.939787 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-bad1eb77-5658-49f5-8611-a3252fc87d15 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:37.945486 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bad1eb77-5658-49f5-8611-a3252fc87d15 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:37.947635 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bad1eb77-5658-49f5-8611-a3252fc87d15 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:37.947635 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bad1eb77-5658-49f5-8611-a3252fc87d15 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:37.947635 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bad1eb77-5658-49f5-8611-a3252fc87d15 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:38.073513 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-bad1eb77-5658-49f5-8611-a3252fc87d15 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:38.081333 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-bad1eb77-5658-49f5-8611-a3252fc87d15 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.145979 May 13 17:27:38.081950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 90/183] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:37 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:38.539429 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-75385381-e7ad-401d-8115-7f7431f65234 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:38.540039 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-75385381-e7ad-401d-8115-7f7431f65234 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:38.545851 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-75385381-e7ad-401d-8115-7f7431f65234 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:38.546304 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-75385381-e7ad-401d-8115-7f7431f65234 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:38.547072 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-75385381-e7ad-401d-8115-7f7431f65234 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:38.547539 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-75385381-e7ad-401d-8115-7f7431f65234 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:38.610366 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c25914fa-cf4f-4e88-a6a5-7a5dd070f6f7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:38.610970 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c25914fa-cf4f-4e88-a6a5-7a5dd070f6f7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:38.616812 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c25914fa-cf4f-4e88-a6a5-7a5dd070f6f7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:38.617265 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c25914fa-cf4f-4e88-a6a5-7a5dd070f6f7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:38.618090 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c25914fa-cf4f-4e88-a6a5-7a5dd070f6f7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:38.618520 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c25914fa-cf4f-4e88-a6a5-7a5dd070f6f7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:38.674468 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-75385381-e7ad-401d-8115-7f7431f65234 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:38.681924 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-75385381-e7ad-401d-8115-7f7431f65234 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.146161 May 13 17:27:38.682571 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 94/184] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:38 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:38.749932 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c25914fa-cf4f-4e88-a6a5-7a5dd070f6f7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:38.758651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c25914fa-cf4f-4e88-a6a5-7a5dd070f6f7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:38.760213 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c25914fa-cf4f-4e88-a6a5-7a5dd070f6f7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:38.761584 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c25914fa-cf4f-4e88-a6a5-7a5dd070f6f7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.155086 May 13 17:27:38.762151 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 91/185] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:38 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:27:38.861083 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-cd1224c8-b6c2-4d2e-bc5f-15acef54ae4a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:38.861763 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-cd1224c8-b6c2-4d2e-bc5f-15acef54ae4a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:38.868143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cd1224c8-b6c2-4d2e-bc5f-15acef54ae4a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:38.868677 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cd1224c8-b6c2-4d2e-bc5f-15acef54ae4a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:38.869519 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cd1224c8-b6c2-4d2e-bc5f-15acef54ae4a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:38.869949 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cd1224c8-b6c2-4d2e-bc5f-15acef54ae4a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:39.012125 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-cd1224c8-b6c2-4d2e-bc5f-15acef54ae4a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:39.020063 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-cd1224c8-b6c2-4d2e-bc5f-15acef54ae4a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.165034 May 13 17:27:39.020612 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 95/186] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:38 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:39.097886 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4523ecf0-338c-4b4d-8584-e18983e28481 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:39.098498 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4523ecf0-338c-4b4d-8584-e18983e28481 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:39.104379 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4523ecf0-338c-4b4d-8584-e18983e28481 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:39.104834 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4523ecf0-338c-4b4d-8584-e18983e28481 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:39.105605 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4523ecf0-338c-4b4d-8584-e18983e28481 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:39.106041 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4523ecf0-338c-4b4d-8584-e18983e28481 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:39.237464 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4523ecf0-338c-4b4d-8584-e18983e28481 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:39.244690 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4523ecf0-338c-4b4d-8584-e18983e28481 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.150597 May 13 17:27:39.245249 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 92/187] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:39 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:39.698664 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-07995d33-16d8-41a0-a1a3-ce194dffc5e3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:39.699467 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-07995d33-16d8-41a0-a1a3-ce194dffc5e3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:39.705712 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-07995d33-16d8-41a0-a1a3-ce194dffc5e3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:39.706303 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-07995d33-16d8-41a0-a1a3-ce194dffc5e3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:39.707393 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-07995d33-16d8-41a0-a1a3-ce194dffc5e3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:39.707901 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-07995d33-16d8-41a0-a1a3-ce194dffc5e3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:39.780139 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2e68aa37-93c4-478c-8c69-17038d4a23cf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:39.780658 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2e68aa37-93c4-478c-8c69-17038d4a23cf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:39.793654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2e68aa37-93c4-478c-8c69-17038d4a23cf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:39.794115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2e68aa37-93c4-478c-8c69-17038d4a23cf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:39.794893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2e68aa37-93c4-478c-8c69-17038d4a23cf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:39.795358 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2e68aa37-93c4-478c-8c69-17038d4a23cf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:39.843653 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-07995d33-16d8-41a0-a1a3-ce194dffc5e3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:39.851598 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-07995d33-16d8-41a0-a1a3-ce194dffc5e3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.157629 May 13 17:27:39.852472 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 96/188] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:39 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:40.004931 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2e68aa37-93c4-478c-8c69-17038d4a23cf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:40.012690 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2e68aa37-93c4-478c-8c69-17038d4a23cf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:40.014667 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2e68aa37-93c4-478c-8c69-17038d4a23cf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:40.015321 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2e68aa37-93c4-478c-8c69-17038d4a23cf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.239010 May 13 17:27:40.015873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 93/189] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:39 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:27:40.037397 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-ecdf772f-7c98-42cc-ad72-caa1d043be8b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:40.038266 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-ecdf772f-7c98-42cc-ad72-caa1d043be8b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:40.043992 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ecdf772f-7c98-42cc-ad72-caa1d043be8b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:40.044449 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ecdf772f-7c98-42cc-ad72-caa1d043be8b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:40.045300 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ecdf772f-7c98-42cc-ad72-caa1d043be8b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:40.045648 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ecdf772f-7c98-42cc-ad72-caa1d043be8b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:40.262896 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f02102e1-68f1-4315-8f24-34a1b7d5a252 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:40.263538 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f02102e1-68f1-4315-8f24-34a1b7d5a252 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:40.277089 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f02102e1-68f1-4315-8f24-34a1b7d5a252 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:40.277559 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f02102e1-68f1-4315-8f24-34a1b7d5a252 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:40.278600 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f02102e1-68f1-4315-8f24-34a1b7d5a252 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:40.279037 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f02102e1-68f1-4315-8f24-34a1b7d5a252 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:40.344672 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-ecdf772f-7c98-42cc-ad72-caa1d043be8b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:40.355338 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-ecdf772f-7c98-42cc-ad72-caa1d043be8b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.321624 May 13 17:27:40.356791 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 97/190] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:40 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:40.484613 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f02102e1-68f1-4315-8f24-34a1b7d5a252 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:40.496911 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f02102e1-68f1-4315-8f24-34a1b7d5a252 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.237900 May 13 17:27:40.497491 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 94/191] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:40 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:40.868393 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-940d2eb8-632b-49aa-b28d-9812dcc15e57 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:40.869002 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-940d2eb8-632b-49aa-b28d-9812dcc15e57 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:40.874738 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-940d2eb8-632b-49aa-b28d-9812dcc15e57 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:40.875244 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-940d2eb8-632b-49aa-b28d-9812dcc15e57 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:40.876003 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-940d2eb8-632b-49aa-b28d-9812dcc15e57 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:40.876439 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-940d2eb8-632b-49aa-b28d-9812dcc15e57 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:41.009986 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-940d2eb8-632b-49aa-b28d-9812dcc15e57 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:41.017207 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-940d2eb8-632b-49aa-b28d-9812dcc15e57 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.152777 May 13 17:27:41.017803 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 98/192] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:40 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:41.033786 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-30058f44-68ee-4a0a-9168-3855f396b8b9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:41.034392 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-30058f44-68ee-4a0a-9168-3855f396b8b9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:41.040286 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-30058f44-68ee-4a0a-9168-3855f396b8b9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:41.040753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-30058f44-68ee-4a0a-9168-3855f396b8b9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:41.041527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-30058f44-68ee-4a0a-9168-3855f396b8b9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:41.041962 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-30058f44-68ee-4a0a-9168-3855f396b8b9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:41.297550 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-30058f44-68ee-4a0a-9168-3855f396b8b9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:41.306320 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-30058f44-68ee-4a0a-9168-3855f396b8b9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:41.307667 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-30058f44-68ee-4a0a-9168-3855f396b8b9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:41.308782 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-30058f44-68ee-4a0a-9168-3855f396b8b9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.278994 May 13 17:27:41.309341 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 95/193] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:41 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:41.372964 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-fdcd8817-ab5a-4788-b6f8-ed653a737ab5 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:41.373577 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-fdcd8817-ab5a-4788-b6f8-ed653a737ab5 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:41.379739 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fdcd8817-ab5a-4788-b6f8-ed653a737ab5 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:41.380130 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fdcd8817-ab5a-4788-b6f8-ed653a737ab5 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:41.380893 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fdcd8817-ab5a-4788-b6f8-ed653a737ab5 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:41.381326 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fdcd8817-ab5a-4788-b6f8-ed653a737ab5 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:41.491681 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-d112b5a3-fd2f-421d-8eb1-c71918f23b28 req-1919bea4-5fb6-41e5-88d0-449c021a4910 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65fdbf1a-f080-4d79-b3f3-c465e5a81c67", "name": "network-vif-plugged", "status": "completed", "tag": "41053781-3367-4859-b7f7-eb83af021a82"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:27:41.500677 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-d112b5a3-fd2f-421d-8eb1-c71918f23b28 req-1919bea4-5fb6-41e5-88d0-449c021a4910 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:41.501953 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-d112b5a3-fd2f-421d-8eb1-c71918f23b28 req-1919bea4-5fb6-41e5-88d0-449c021a4910 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:41.514282 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-d112b5a3-fd2f-421d-8eb1-c71918f23b28 req-1919bea4-5fb6-41e5-88d0-449c021a4910 service nova] Creating event network-vif-plugged:41053781-3367-4859-b7f7-eb83af021a82 for instance 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 on hv-cinder-84178 May 13 17:27:41.519428 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-d112b5a3-fd2f-421d-8eb1-c71918f23b28 req-1919bea4-5fb6-41e5-88d0-449c021a4910 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031298 May 13 17:27:41.520137 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 96/194] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:27:41.526582 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-64578396-8164-4a2d-be53-50130be9da33 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:41.527417 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-64578396-8164-4a2d-be53-50130be9da33 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:41.534386 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-64578396-8164-4a2d-be53-50130be9da33 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:41.539668 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-64578396-8164-4a2d-be53-50130be9da33 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:41.539668 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-64578396-8164-4a2d-be53-50130be9da33 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:41.539668 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-64578396-8164-4a2d-be53-50130be9da33 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:41.559586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-fdcd8817-ab5a-4788-b6f8-ed653a737ab5 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:41.594755 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-fdcd8817-ab5a-4788-b6f8-ed653a737ab5 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.225546 May 13 17:27:41.597639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 99/195] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:41 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:41.705743 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-64578396-8164-4a2d-be53-50130be9da33 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:41.713901 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-64578396-8164-4a2d-be53-50130be9da33 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.192366 May 13 17:27:41.714575 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 97/196] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:41 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:42.033864 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d2b9f4fe-caea-4f85-b2d0-2123a5cee176 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:42.034467 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d2b9f4fe-caea-4f85-b2d0-2123a5cee176 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:42.040651 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d2b9f4fe-caea-4f85-b2d0-2123a5cee176 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:42.041096 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d2b9f4fe-caea-4f85-b2d0-2123a5cee176 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:42.041853 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d2b9f4fe-caea-4f85-b2d0-2123a5cee176 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:42.042281 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d2b9f4fe-caea-4f85-b2d0-2123a5cee176 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:42.187268 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d2b9f4fe-caea-4f85-b2d0-2123a5cee176 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:42.195239 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d2b9f4fe-caea-4f85-b2d0-2123a5cee176 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.165178 May 13 17:27:42.195787 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 100/197] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:42 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:42.326730 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-00a169b4-5108-4ad0-b06e-6e4304be9c4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:42.327419 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-00a169b4-5108-4ad0-b06e-6e4304be9c4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:42.333491 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-00a169b4-5108-4ad0-b06e-6e4304be9c4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:42.333933 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-00a169b4-5108-4ad0-b06e-6e4304be9c4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:42.334686 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-00a169b4-5108-4ad0-b06e-6e4304be9c4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:42.335812 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-00a169b4-5108-4ad0-b06e-6e4304be9c4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:42.506216 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-00a169b4-5108-4ad0-b06e-6e4304be9c4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:42.514107 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-00a169b4-5108-4ad0-b06e-6e4304be9c4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:42.515655 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-00a169b4-5108-4ad0-b06e-6e4304be9c4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:42.516784 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-00a169b4-5108-4ad0-b06e-6e4304be9c4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.194009 May 13 17:27:42.520111 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 98/198] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:42 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:42.614081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-55efd4f1-a07b-4d69-a602-a1274967273b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:42.614702 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-55efd4f1-a07b-4d69-a602-a1274967273b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:42.620684 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-55efd4f1-a07b-4d69-a602-a1274967273b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:42.621126 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-55efd4f1-a07b-4d69-a602-a1274967273b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:42.621874 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-55efd4f1-a07b-4d69-a602-a1274967273b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:42.622415 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-55efd4f1-a07b-4d69-a602-a1274967273b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:42.733397 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2464f4e9-014b-429e-90f8-4132ad08315b tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:42.734292 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2464f4e9-014b-429e-90f8-4132ad08315b tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:42.752843 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2464f4e9-014b-429e-90f8-4132ad08315b tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:42.753492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2464f4e9-014b-429e-90f8-4132ad08315b tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:42.754470 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2464f4e9-014b-429e-90f8-4132ad08315b tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:42.754902 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2464f4e9-014b-429e-90f8-4132ad08315b tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:42.784379 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-55efd4f1-a07b-4d69-a602-a1274967273b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:42.791753 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-55efd4f1-a07b-4d69-a602-a1274967273b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.182087 May 13 17:27:42.795367 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 101/199] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:42 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:27:42.886615 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2464f4e9-014b-429e-90f8-4132ad08315b tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:42.894400 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2464f4e9-014b-429e-90f8-4132ad08315b tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.166346 May 13 17:27:42.895078 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 99/200] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:42 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:43.223765 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a878b6d7-d223-4975-8c87-873a28a2ad23 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:43.223765 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a878b6d7-d223-4975-8c87-873a28a2ad23 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:43.223765 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a878b6d7-d223-4975-8c87-873a28a2ad23 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:43.223765 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a878b6d7-d223-4975-8c87-873a28a2ad23 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:43.224160 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a878b6d7-d223-4975-8c87-873a28a2ad23 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:43.224160 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a878b6d7-d223-4975-8c87-873a28a2ad23 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:43.350466 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a878b6d7-d223-4975-8c87-873a28a2ad23 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:43.357729 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a878b6d7-d223-4975-8c87-873a28a2ad23 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.149594 May 13 17:27:43.358285 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 102/201] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:43 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:43.534979 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1163fedf-7a43-4abd-b53d-473f64e18122 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:43.535591 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1163fedf-7a43-4abd-b53d-473f64e18122 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:43.541221 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1163fedf-7a43-4abd-b53d-473f64e18122 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:43.541660 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1163fedf-7a43-4abd-b53d-473f64e18122 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:43.542406 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1163fedf-7a43-4abd-b53d-473f64e18122 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:43.542834 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1163fedf-7a43-4abd-b53d-473f64e18122 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:43.683888 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1163fedf-7a43-4abd-b53d-473f64e18122 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:43.691917 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1163fedf-7a43-4abd-b53d-473f64e18122 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:43.693467 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1163fedf-7a43-4abd-b53d-473f64e18122 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:43.694583 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1163fedf-7a43-4abd-b53d-473f64e18122 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.163562 May 13 17:27:43.695176 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 100/202] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:43 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:43.809348 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-0287e1e9-c07a-4cbf-a93a-ee8dda2083ea tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:43.809930 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-0287e1e9-c07a-4cbf-a93a-ee8dda2083ea tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:43.816948 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0287e1e9-c07a-4cbf-a93a-ee8dda2083ea tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:43.821289 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0287e1e9-c07a-4cbf-a93a-ee8dda2083ea tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:43.821289 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0287e1e9-c07a-4cbf-a93a-ee8dda2083ea tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:43.821289 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0287e1e9-c07a-4cbf-a93a-ee8dda2083ea tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:43.912497 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-859f266a-039e-4b18-8817-604b53abe847 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:43.913726 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-859f266a-039e-4b18-8817-604b53abe847 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:43.922301 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-859f266a-039e-4b18-8817-604b53abe847 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:43.922804 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-859f266a-039e-4b18-8817-604b53abe847 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:43.924208 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-859f266a-039e-4b18-8817-604b53abe847 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:43.924665 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-859f266a-039e-4b18-8817-604b53abe847 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:44.016820 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0287e1e9-c07a-4cbf-a93a-ee8dda2083ea tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:44.023145 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-0287e1e9-c07a-4cbf-a93a-ee8dda2083ea tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.217724 May 13 17:27:44.024144 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 103/203] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:43 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:44.132885 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-859f266a-039e-4b18-8817-604b53abe847 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:44.140172 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-859f266a-039e-4b18-8817-604b53abe847 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.233106 May 13 17:27:44.141166 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 101/204] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:43 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:27:44.376050 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-4aad6663-fb28-48ba-9c4a-3bad2dda9473 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:44.377397 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-4aad6663-fb28-48ba-9c4a-3bad2dda9473 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:44.384090 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4aad6663-fb28-48ba-9c4a-3bad2dda9473 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:44.384596 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4aad6663-fb28-48ba-9c4a-3bad2dda9473 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:44.385614 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4aad6663-fb28-48ba-9c4a-3bad2dda9473 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:44.386104 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4aad6663-fb28-48ba-9c4a-3bad2dda9473 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:44.514551 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-4aad6663-fb28-48ba-9c4a-3bad2dda9473 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:44.522206 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-4aad6663-fb28-48ba-9c4a-3bad2dda9473 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.152266 May 13 17:27:44.522790 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 104/205] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:44 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:27:44.712704 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-84b17707-4ccf-436f-a0cc-9d35c3d85988 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:44.713315 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-84b17707-4ccf-436f-a0cc-9d35c3d85988 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:44.719451 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-84b17707-4ccf-436f-a0cc-9d35c3d85988 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:44.719879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-84b17707-4ccf-436f-a0cc-9d35c3d85988 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:44.720709 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-84b17707-4ccf-436f-a0cc-9d35c3d85988 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:44.721660 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-84b17707-4ccf-436f-a0cc-9d35c3d85988 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:44.855630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-84b17707-4ccf-436f-a0cc-9d35c3d85988 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:44.864439 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-84b17707-4ccf-436f-a0cc-9d35c3d85988 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:44.866044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-84b17707-4ccf-436f-a0cc-9d35c3d85988 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:44.867311 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-84b17707-4ccf-436f-a0cc-9d35c3d85988 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.158370 May 13 17:27:44.867956 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 102/206] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:44 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:45.040845 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-8e1b8005-5681-4148-a9a7-a767a1da3b09 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:45.041419 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-8e1b8005-5681-4148-a9a7-a767a1da3b09 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:45.047408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8e1b8005-5681-4148-a9a7-a767a1da3b09 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:45.047852 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8e1b8005-5681-4148-a9a7-a767a1da3b09 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:45.048621 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8e1b8005-5681-4148-a9a7-a767a1da3b09 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:45.049062 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8e1b8005-5681-4148-a9a7-a767a1da3b09 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:45.157486 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a78663ec-2872-4bf1-9930-5dfa48fb6053 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:45.158645 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a78663ec-2872-4bf1-9930-5dfa48fb6053 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:45.167388 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a78663ec-2872-4bf1-9930-5dfa48fb6053 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:45.167840 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a78663ec-2872-4bf1-9930-5dfa48fb6053 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:45.168843 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a78663ec-2872-4bf1-9930-5dfa48fb6053 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:45.169277 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a78663ec-2872-4bf1-9930-5dfa48fb6053 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:45.224936 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-8e1b8005-5681-4148-a9a7-a767a1da3b09 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:45.235449 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-8e1b8005-5681-4148-a9a7-a767a1da3b09 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.198641 May 13 17:27:45.236043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 105/207] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:45 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:45.365958 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a78663ec-2872-4bf1-9930-5dfa48fb6053 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:45.373400 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a78663ec-2872-4bf1-9930-5dfa48fb6053 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.219963 May 13 17:27:45.374199 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 103/208] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:45 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:27:45.540909 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-5a9028be-725f-49a5-a348-8c27e1ab796b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:45.541519 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-5a9028be-725f-49a5-a348-8c27e1ab796b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:45.548060 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5a9028be-725f-49a5-a348-8c27e1ab796b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:45.548576 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5a9028be-725f-49a5-a348-8c27e1ab796b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:45.549989 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5a9028be-725f-49a5-a348-8c27e1ab796b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:45.550480 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5a9028be-725f-49a5-a348-8c27e1ab796b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:45.678345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-5a9028be-725f-49a5-a348-8c27e1ab796b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:45.685620 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-5a9028be-725f-49a5-a348-8c27e1ab796b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.148517 May 13 17:27:45.686182 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 106/209] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:45 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:45.884979 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d06980d5-0197-4cae-9cd3-430471822fee tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:45.885493 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d06980d5-0197-4cae-9cd3-430471822fee tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:45.891496 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d06980d5-0197-4cae-9cd3-430471822fee tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:45.891940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d06980d5-0197-4cae-9cd3-430471822fee tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:45.892707 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d06980d5-0197-4cae-9cd3-430471822fee tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:45.893143 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d06980d5-0197-4cae-9cd3-430471822fee tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:46.046116 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d06980d5-0197-4cae-9cd3-430471822fee tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:46.054724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d06980d5-0197-4cae-9cd3-430471822fee tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:46.056342 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d06980d5-0197-4cae-9cd3-430471822fee tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:46.057518 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d06980d5-0197-4cae-9cd3-430471822fee tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.176457 May 13 17:27:46.058185 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 104/210] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:45 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:46.254585 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-dcf98a87-319c-4f5d-8131-5e4d9c17f65d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:46.255220 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-dcf98a87-319c-4f5d-8131-5e4d9c17f65d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:46.261098 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dcf98a87-319c-4f5d-8131-5e4d9c17f65d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:46.261549 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dcf98a87-319c-4f5d-8131-5e4d9c17f65d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:46.262316 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dcf98a87-319c-4f5d-8131-5e4d9c17f65d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:46.262867 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dcf98a87-319c-4f5d-8131-5e4d9c17f65d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:46.393155 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8da4c446-b379-42a8-bf18-5255bbe7d8df tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:46.393769 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8da4c446-b379-42a8-bf18-5255bbe7d8df tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:46.400005 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8da4c446-b379-42a8-bf18-5255bbe7d8df tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:46.400646 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8da4c446-b379-42a8-bf18-5255bbe7d8df tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:46.401421 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8da4c446-b379-42a8-bf18-5255bbe7d8df tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:46.402017 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8da4c446-b379-42a8-bf18-5255bbe7d8df tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:46.464644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-dcf98a87-319c-4f5d-8131-5e4d9c17f65d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:46.473636 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-dcf98a87-319c-4f5d-8131-5e4d9c17f65d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.222762 May 13 17:27:46.474211 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 107/211] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:46 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:46.549622 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8da4c446-b379-42a8-bf18-5255bbe7d8df tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:46.558913 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8da4c446-b379-42a8-bf18-5255bbe7d8df tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.168741 May 13 17:27:46.558913 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 105/212] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:46 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:27:46.702813 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-dca42ae7-c5c4-469e-8dfb-99bcbba25cbf tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:46.703369 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-dca42ae7-c5c4-469e-8dfb-99bcbba25cbf tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:46.709157 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dca42ae7-c5c4-469e-8dfb-99bcbba25cbf tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:46.709656 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dca42ae7-c5c4-469e-8dfb-99bcbba25cbf tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:46.710423 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dca42ae7-c5c4-469e-8dfb-99bcbba25cbf tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:46.710862 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dca42ae7-c5c4-469e-8dfb-99bcbba25cbf tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:46.836845 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-dca42ae7-c5c4-469e-8dfb-99bcbba25cbf tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:46.844784 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-dca42ae7-c5c4-469e-8dfb-99bcbba25cbf tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.145808 May 13 17:27:46.846224 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 108/213] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:46 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:47.075055 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2996f3b5-47c2-4d6f-97dc-283ecc072b0b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:47.076362 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2996f3b5-47c2-4d6f-97dc-283ecc072b0b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:47.082998 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2996f3b5-47c2-4d6f-97dc-283ecc072b0b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:47.083483 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2996f3b5-47c2-4d6f-97dc-283ecc072b0b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:47.084242 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2996f3b5-47c2-4d6f-97dc-283ecc072b0b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:47.084676 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2996f3b5-47c2-4d6f-97dc-283ecc072b0b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:47.220730 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2996f3b5-47c2-4d6f-97dc-283ecc072b0b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:47.228750 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2996f3b5-47c2-4d6f-97dc-283ecc072b0b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:47.230249 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2996f3b5-47c2-4d6f-97dc-283ecc072b0b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:47.231592 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2996f3b5-47c2-4d6f-97dc-283ecc072b0b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.160331 May 13 17:27:47.232147 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 106/214] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:47 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:47.489967 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-64103201-4b5b-41c7-858c-4ec07cbfe345 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:47.490867 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-64103201-4b5b-41c7-858c-4ec07cbfe345 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:47.498364 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-64103201-4b5b-41c7-858c-4ec07cbfe345 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:47.499608 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-64103201-4b5b-41c7-858c-4ec07cbfe345 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:47.500873 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-64103201-4b5b-41c7-858c-4ec07cbfe345 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:47.502296 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-64103201-4b5b-41c7-858c-4ec07cbfe345 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:47.575144 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9b9a7cb7-00ec-489c-babb-2101ea2b918a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:47.575954 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9b9a7cb7-00ec-489c-babb-2101ea2b918a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:47.582200 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9b9a7cb7-00ec-489c-babb-2101ea2b918a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:47.582646 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9b9a7cb7-00ec-489c-babb-2101ea2b918a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:47.583873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9b9a7cb7-00ec-489c-babb-2101ea2b918a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:47.584457 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9b9a7cb7-00ec-489c-babb-2101ea2b918a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:47.655398 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-64103201-4b5b-41c7-858c-4ec07cbfe345 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:47.665191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-64103201-4b5b-41c7-858c-4ec07cbfe345 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.179185 May 13 17:27:47.675065 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 109/215] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:47 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:47.741816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9b9a7cb7-00ec-489c-babb-2101ea2b918a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:47.749267 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9b9a7cb7-00ec-489c-babb-2101ea2b918a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1366 microversion: 2.1 time: 0.178915 May 13 17:27:47.750440 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 107/216] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:47 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:27:47.862900 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-de3fb737-c22a-4a65-8d94-8d942b214941 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:47.863946 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-de3fb737-c22a-4a65-8d94-8d942b214941 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:47.870396 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-de3fb737-c22a-4a65-8d94-8d942b214941 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:47.870540 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-de3fb737-c22a-4a65-8d94-8d942b214941 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:47.871524 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-de3fb737-c22a-4a65-8d94-8d942b214941 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:47.872413 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-de3fb737-c22a-4a65-8d94-8d942b214941 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:48.018507 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-de3fb737-c22a-4a65-8d94-8d942b214941 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:48.026094 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-de3fb737-c22a-4a65-8d94-8d942b214941 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.167587 May 13 17:27:48.026679 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 110/217] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:47 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:48.249295 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0c1881ce-d843-4f36-b6e5-c3aafdcbd54b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:48.249992 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0c1881ce-d843-4f36-b6e5-c3aafdcbd54b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:48.255734 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0c1881ce-d843-4f36-b6e5-c3aafdcbd54b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:48.256174 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0c1881ce-d843-4f36-b6e5-c3aafdcbd54b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:48.257020 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0c1881ce-d843-4f36-b6e5-c3aafdcbd54b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:48.257378 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0c1881ce-d843-4f36-b6e5-c3aafdcbd54b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:48.387869 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0c1881ce-d843-4f36-b6e5-c3aafdcbd54b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:48.396823 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0c1881ce-d843-4f36-b6e5-c3aafdcbd54b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:48.398343 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0c1881ce-d843-4f36-b6e5-c3aafdcbd54b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:48.403395 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0c1881ce-d843-4f36-b6e5-c3aafdcbd54b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.153955 May 13 17:27:48.403395 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 108/218] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:48 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:48.681943 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-943457ca-b15a-4f29-a27f-b86698198774 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:48.682549 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-943457ca-b15a-4f29-a27f-b86698198774 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:48.688828 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-943457ca-b15a-4f29-a27f-b86698198774 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:48.689997 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-943457ca-b15a-4f29-a27f-b86698198774 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:48.690924 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-943457ca-b15a-4f29-a27f-b86698198774 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:48.691540 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-943457ca-b15a-4f29-a27f-b86698198774 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:48.766451 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c8d489af-8f90-4a00-8c00-2c711807b1e0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:48.767053 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c8d489af-8f90-4a00-8c00-2c711807b1e0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:48.773614 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c8d489af-8f90-4a00-8c00-2c711807b1e0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:48.774056 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c8d489af-8f90-4a00-8c00-2c711807b1e0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:48.774815 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c8d489af-8f90-4a00-8c00-2c711807b1e0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:48.775263 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c8d489af-8f90-4a00-8c00-2c711807b1e0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:48.826639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-943457ca-b15a-4f29-a27f-b86698198774 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:48.834767 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-943457ca-b15a-4f29-a27f-b86698198774 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.156757 May 13 17:27:48.835372 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 111/219] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:48 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:48.916418 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c8d489af-8f90-4a00-8c00-2c711807b1e0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:48.923785 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c8d489af-8f90-4a00-8c00-2c711807b1e0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1557 microversion: 2.1 time: 0.161184 May 13 17:27:48.924338 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 109/220] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:48 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1557 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:27:48.944712 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-5a7a6da5-6303-4aa2-b9ae-0a57eee978f0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:48.945221 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-5a7a6da5-6303-4aa2-b9ae-0a57eee978f0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:48.950929 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5a7a6da5-6303-4aa2-b9ae-0a57eee978f0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:48.951405 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5a7a6da5-6303-4aa2-b9ae-0a57eee978f0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:48.952273 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5a7a6da5-6303-4aa2-b9ae-0a57eee978f0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:48.953205 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5a7a6da5-6303-4aa2-b9ae-0a57eee978f0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:49.043611 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3ee5edb8-1f0a-4a69-b808-6c89bf1633c8 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:49.044260 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3ee5edb8-1f0a-4a69-b808-6c89bf1633c8 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:49.052648 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3ee5edb8-1f0a-4a69-b808-6c89bf1633c8 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:49.053387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3ee5edb8-1f0a-4a69-b808-6c89bf1633c8 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:49.054157 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3ee5edb8-1f0a-4a69-b808-6c89bf1633c8 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:49.054593 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3ee5edb8-1f0a-4a69-b808-6c89bf1633c8 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:49.070871 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-5a7a6da5-6303-4aa2-b9ae-0a57eee978f0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.129901 May 13 17:27:49.071486 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 112/221] 10.222.0.64 () {58 vars in 1274 bytes} [Fri May 13 17:27:48 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0/os-interface => generated 285 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:27:49.419489 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-37e27d06-1145-4390-afdc-1e1a19756458 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:49.420096 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-37e27d06-1145-4390-afdc-1e1a19756458 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:49.434753 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-37e27d06-1145-4390-afdc-1e1a19756458 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:49.435401 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-37e27d06-1145-4390-afdc-1e1a19756458 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:49.436284 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-37e27d06-1145-4390-afdc-1e1a19756458 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:49.437933 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-37e27d06-1145-4390-afdc-1e1a19756458 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:49.554503 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3ee5edb8-1f0a-4a69-b808-6c89bf1633c8 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:49.565977 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3ee5edb8-1f0a-4a69-b808-6c89bf1633c8 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.526047 May 13 17:27:49.566874 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 110/222] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:49 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:27:49.598253 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-37e27d06-1145-4390-afdc-1e1a19756458 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:49.608643 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-37e27d06-1145-4390-afdc-1e1a19756458 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:49.610160 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-37e27d06-1145-4390-afdc-1e1a19756458 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:49.611907 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-37e27d06-1145-4390-afdc-1e1a19756458 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.195616 May 13 17:27:49.612841 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 113/223] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:49 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:27:49.851956 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3feb49c2-81b0-487f-a189-3472d7e96e13 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:49.852748 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3feb49c2-81b0-487f-a189-3472d7e96e13 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:49.859642 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3feb49c2-81b0-487f-a189-3472d7e96e13 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:49.863896 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3feb49c2-81b0-487f-a189-3472d7e96e13 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:49.865022 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3feb49c2-81b0-487f-a189-3472d7e96e13 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:49.865781 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3feb49c2-81b0-487f-a189-3472d7e96e13 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:50.022867 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a041d56e-69e6-4cf6-a3f4-e5baa50185ee tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-449746834", "imageRef": "7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88", "flavorRef": "452"}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:27:50.081689 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.network.neutron [None req-a041d56e-69e6-4cf6-a3f4-e5baa50185ee tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] validate_networks() for None {{(pid=117492) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 17:27:50.164596 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3feb49c2-81b0-487f-a189-3472d7e96e13 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:50.172503 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3feb49c2-81b0-487f-a189-3472d7e96e13 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.324388 May 13 17:27:50.173235 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 111/224] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:49 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:50.534093 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-a041d56e-69e6-4cf6-a3f4-e5baa50185ee tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Flavor limits 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 17:27:50.534848 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-a041d56e-69e6-4cf6-a3f4-e5baa50185ee tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Image limits 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 17:27:50.535356 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-a041d56e-69e6-4cf6-a3f4-e5baa50185ee tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Flavor pref 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 17:27:50.535771 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-a041d56e-69e6-4cf6-a3f4-e5baa50185ee tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Image pref 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 17:27:50.536184 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-a041d56e-69e6-4cf6-a3f4-e5baa50185ee tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 17:27:50.545277 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a041d56e-69e6-4cf6-a3f4-e5baa50185ee tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:50.545751 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a041d56e-69e6-4cf6-a3f4-e5baa50185ee tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:50.546598 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a041d56e-69e6-4cf6-a3f4-e5baa50185ee tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:50.547037 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a041d56e-69e6-4cf6-a3f4-e5baa50185ee tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:50.569067 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-a041d56e-69e6-4cf6-a3f4-e5baa50185ee tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Getting quotas for project 1e8b971013bf492988f7119cf63c69bc. Resources: {'ram', 'instances', 'cores'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:27:50.573674 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-a041d56e-69e6-4cf6-a3f4-e5baa50185ee tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Getting quotas for user 10e55f76eeaa46928289da220ceca447 and project 1e8b971013bf492988f7119cf63c69bc. Resources: {'ram', 'instances', 'cores'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:27:50.583487 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c2b8f189-9e80-4e1d-a874-a4642f71b6e1 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:50.584785 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c2b8f189-9e80-4e1d-a874-a4642f71b6e1 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:50.587425 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a041d56e-69e6-4cf6-a3f4-e5baa50185ee tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Going to run 1 instances... {{(pid=117492) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 17:27:50.590765 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a041d56e-69e6-4cf6-a3f4-e5baa50185ee tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 17:27:50.591788 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c2b8f189-9e80-4e1d-a874-a4642f71b6e1 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:50.592279 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c2b8f189-9e80-4e1d-a874-a4642f71b6e1 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:50.593014 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c2b8f189-9e80-4e1d-a874-a4642f71b6e1 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:50.593709 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c2b8f189-9e80-4e1d-a874-a4642f71b6e1 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:50.795639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a041d56e-69e6-4cf6-a3f4-e5baa50185ee tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.777706 May 13 17:27:50.796493 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 114/225] 10.222.0.64 () {60 vars in 1146 bytes} [Fri May 13 17:27:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 779 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 17:27:50.801663 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-06eec0dc-27c7-4752-918d-c66b173fda27 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:50.802617 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-06eec0dc-27c7-4752-918d-c66b173fda27 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:50.808912 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-06eec0dc-27c7-4752-918d-c66b173fda27 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:50.809408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-06eec0dc-27c7-4752-918d-c66b173fda27 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:50.810190 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-06eec0dc-27c7-4752-918d-c66b173fda27 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:50.810631 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-06eec0dc-27c7-4752-918d-c66b173fda27 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:50.981490 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-06eec0dc-27c7-4752-918d-c66b173fda27 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:50.993059 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-06eec0dc-27c7-4752-918d-c66b173fda27 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:50.994960 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-06eec0dc-27c7-4752-918d-c66b173fda27 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:50.996239 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-06eec0dc-27c7-4752-918d-c66b173fda27 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.198837 May 13 17:27:51.003640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 115/226] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:50 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:51.011350 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c2b8f189-9e80-4e1d-a874-a4642f71b6e1 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:51.020330 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c2b8f189-9e80-4e1d-a874-a4642f71b6e1 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1315 microversion: 2.1 time: 0.438004 May 13 17:27:51.020932 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 112/227] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:50 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1315 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:51.022094 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-9633d2b4-f07d-4a81-8937-9c89c0ab7dc4 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:51.022898 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-9633d2b4-f07d-4a81-8937-9c89c0ab7dc4 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:51.073259 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-671ebdc6-aaea-4540-9ae7-02de4981a221 req-c2b1d3cf-6c58-4c12-99dd-ffb65eb905e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "271501e4-dcad-4de1-92a7-8ad28c0dc5e0", "tag": "6c67b852-5901-4a54-9821-0cbca68ceaca"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:27:51.081442 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-671ebdc6-aaea-4540-9ae7-02de4981a221 req-c2b1d3cf-6c58-4c12-99dd-ffb65eb905e3 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:51.082619 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-671ebdc6-aaea-4540-9ae7-02de4981a221 req-c2b1d3cf-6c58-4c12-99dd-ffb65eb905e3 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:51.101372 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-9633d2b4-f07d-4a81-8937-9c89c0ab7dc4 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:51.108291 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-9633d2b4-f07d-4a81-8937-9c89c0ab7dc4 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1214 microversion: 2.1 time: 0.101176 May 13 17:27:51.108945 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 116/228] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:51 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1214 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:51.181369 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-671ebdc6-aaea-4540-9ae7-02de4981a221 req-c2b1d3cf-6c58-4c12-99dd-ffb65eb905e3 service nova] Creating event network-changed:6c67b852-5901-4a54-9821-0cbca68ceaca for instance 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 on hv-cinder-84178 May 13 17:27:51.187159 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-671ebdc6-aaea-4540-9ae7-02de4981a221 req-c2b1d3cf-6c58-4c12-99dd-ffb65eb905e3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125082 May 13 17:27:51.187919 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 113/229] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:27:51.189834 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-648b66e6-540a-46fd-b28e-60f6ba491dab tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:51.190537 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-648b66e6-540a-46fd-b28e-60f6ba491dab tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:51.196743 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-648b66e6-540a-46fd-b28e-60f6ba491dab tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:51.197187 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-648b66e6-540a-46fd-b28e-60f6ba491dab tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:51.197956 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-648b66e6-540a-46fd-b28e-60f6ba491dab tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:51.198386 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-648b66e6-540a-46fd-b28e-60f6ba491dab tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:51.398310 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-648b66e6-540a-46fd-b28e-60f6ba491dab tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:51.414521 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-648b66e6-540a-46fd-b28e-60f6ba491dab tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.228938 May 13 17:27:51.415450 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 117/230] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:51 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:27:52.014723 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e11c02de-8373-44e7-b7aa-005e35612cec tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:52.015633 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e11c02de-8373-44e7-b7aa-005e35612cec tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:52.024657 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e11c02de-8373-44e7-b7aa-005e35612cec tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:52.025313 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e11c02de-8373-44e7-b7aa-005e35612cec tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:52.026425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e11c02de-8373-44e7-b7aa-005e35612cec tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:52.027065 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e11c02de-8373-44e7-b7aa-005e35612cec tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:52.039415 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-663b17a0-9ce1-4126-90d6-086d8505952b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:52.040030 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-663b17a0-9ce1-4126-90d6-086d8505952b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:52.047381 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-663b17a0-9ce1-4126-90d6-086d8505952b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:52.051411 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-663b17a0-9ce1-4126-90d6-086d8505952b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:52.052359 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-663b17a0-9ce1-4126-90d6-086d8505952b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:52.058247 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-663b17a0-9ce1-4126-90d6-086d8505952b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:52.245235 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e11c02de-8373-44e7-b7aa-005e35612cec tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:52.275333 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e11c02de-8373-44e7-b7aa-005e35612cec tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:52.278272 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-663b17a0-9ce1-4126-90d6-086d8505952b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:52.280572 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e11c02de-8373-44e7-b7aa-005e35612cec tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:52.283901 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e11c02de-8373-44e7-b7aa-005e35612cec tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.272912 May 13 17:27:52.296710 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-663b17a0-9ce1-4126-90d6-086d8505952b tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1500 microversion: 2.1 time: 0.262506 May 13 17:27:52.296990 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 114/231] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:52 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:52.297542 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 118/232] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:52 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1500 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:52.311846 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c5e7c144-4920-4cf5-bce5-08bf521f9d13 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:52.313307 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c5e7c144-4920-4cf5-bce5-08bf521f9d13 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:52.320405 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c5e7c144-4920-4cf5-bce5-08bf521f9d13 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:52.321191 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c5e7c144-4920-4cf5-bce5-08bf521f9d13 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:52.322334 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c5e7c144-4920-4cf5-bce5-08bf521f9d13 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:52.322892 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c5e7c144-4920-4cf5-bce5-08bf521f9d13 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:52.418224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c5e7c144-4920-4cf5-bce5-08bf521f9d13 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:52.425070 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c5e7c144-4920-4cf5-bce5-08bf521f9d13 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1218 microversion: 2.1 time: 0.124636 May 13 17:27:52.427191 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 115/233] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:52 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1218 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:52.440836 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-13407345-4759-4b7e-b350-2f629f1301c3 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:52.441714 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-13407345-4759-4b7e-b350-2f629f1301c3 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:52.448022 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-13407345-4759-4b7e-b350-2f629f1301c3 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:52.448533 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-13407345-4759-4b7e-b350-2f629f1301c3 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:52.452181 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-13407345-4759-4b7e-b350-2f629f1301c3 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:52.452181 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-13407345-4759-4b7e-b350-2f629f1301c3 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:52.594269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-13407345-4759-4b7e-b350-2f629f1301c3 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:52.602827 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-13407345-4759-4b7e-b350-2f629f1301c3 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.166275 May 13 17:27:52.604084 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 119/234] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:52 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:53.301565 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-92cf7353-04d4-45b8-9489-28666aeb9c2d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:53.302109 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-92cf7353-04d4-45b8-9489-28666aeb9c2d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:53.308072 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-92cf7353-04d4-45b8-9489-28666aeb9c2d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:53.308525 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-92cf7353-04d4-45b8-9489-28666aeb9c2d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:53.309324 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-92cf7353-04d4-45b8-9489-28666aeb9c2d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:53.309760 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-92cf7353-04d4-45b8-9489-28666aeb9c2d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:53.444256 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-5ef9492e-1fb7-4d76-9be8-b750b5eb05a2 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:53.444857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-5ef9492e-1fb7-4d76-9be8-b750b5eb05a2 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:53.452166 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5ef9492e-1fb7-4d76-9be8-b750b5eb05a2 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:53.452802 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5ef9492e-1fb7-4d76-9be8-b750b5eb05a2 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:53.453993 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5ef9492e-1fb7-4d76-9be8-b750b5eb05a2 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:53.454577 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5ef9492e-1fb7-4d76-9be8-b750b5eb05a2 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:53.472482 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-92cf7353-04d4-45b8-9489-28666aeb9c2d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:53.482304 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-92cf7353-04d4-45b8-9489-28666aeb9c2d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:53.483903 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-92cf7353-04d4-45b8-9489-28666aeb9c2d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:53.485236 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-92cf7353-04d4-45b8-9489-28666aeb9c2d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.187655 May 13 17:27:53.485972 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 116/235] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:53 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:53.539035 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-5ef9492e-1fb7-4d76-9be8-b750b5eb05a2 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:53.550597 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-5ef9492e-1fb7-4d76-9be8-b750b5eb05a2 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1210 microversion: 2.1 time: 0.111334 May 13 17:27:53.551564 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 120/236] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:53 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1210 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:53.620969 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-41fc7005-c22c-4020-b51d-4304d7960f7c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:53.621630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-41fc7005-c22c-4020-b51d-4304d7960f7c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:53.628318 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-41fc7005-c22c-4020-b51d-4304d7960f7c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:53.628773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-41fc7005-c22c-4020-b51d-4304d7960f7c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:53.631508 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-41fc7005-c22c-4020-b51d-4304d7960f7c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:53.631508 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-41fc7005-c22c-4020-b51d-4304d7960f7c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:53.773522 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-45425892-39a1-40e9-91d0-6be1ced3c293 req-d030545e-ce64-4e09-aa00-4f55f3cedbdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a72fdd8-ca24-4ae1-b007-7e22f411ad48", "name": "network-vif-plugged", "status": "completed", "tag": "65e4c296-6b3c-4eb9-a923-4c5f6eab3710"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:27:53.782141 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-45425892-39a1-40e9-91d0-6be1ced3c293 req-d030545e-ce64-4e09-aa00-4f55f3cedbdf service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:53.782574 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-45425892-39a1-40e9-91d0-6be1ced3c293 req-d030545e-ce64-4e09-aa00-4f55f3cedbdf service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:53.794173 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-45425892-39a1-40e9-91d0-6be1ced3c293 req-d030545e-ce64-4e09-aa00-4f55f3cedbdf service nova] Creating event network-vif-plugged:65e4c296-6b3c-4eb9-a923-4c5f6eab3710 for instance 9a72fdd8-ca24-4ae1-b007-7e22f411ad48 on hv-cinder-84178 May 13 17:27:53.799472 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-45425892-39a1-40e9-91d0-6be1ced3c293 req-d030545e-ce64-4e09-aa00-4f55f3cedbdf service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030057 May 13 17:27:53.800073 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 121/237] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:27:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:27:53.812390 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-41fc7005-c22c-4020-b51d-4304d7960f7c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:53.820060 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-41fc7005-c22c-4020-b51d-4304d7960f7c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.202851 May 13 17:27:53.820632 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 117/238] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:53 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:54.503688 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a346ce0a-15e9-4d4a-88b6-de07fbc9d5fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:54.504377 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a346ce0a-15e9-4d4a-88b6-de07fbc9d5fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:54.510346 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a346ce0a-15e9-4d4a-88b6-de07fbc9d5fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:54.510787 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a346ce0a-15e9-4d4a-88b6-de07fbc9d5fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:54.511576 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a346ce0a-15e9-4d4a-88b6-de07fbc9d5fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:54.512007 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a346ce0a-15e9-4d4a-88b6-de07fbc9d5fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:54.572186 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-dec98a46-41d0-4c6a-84f3-6232bdd7bdbe tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:54.572922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-dec98a46-41d0-4c6a-84f3-6232bdd7bdbe tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:54.578937 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dec98a46-41d0-4c6a-84f3-6232bdd7bdbe tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:54.579415 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dec98a46-41d0-4c6a-84f3-6232bdd7bdbe tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:54.580218 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dec98a46-41d0-4c6a-84f3-6232bdd7bdbe tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:54.581186 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dec98a46-41d0-4c6a-84f3-6232bdd7bdbe tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:54.644127 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-dec98a46-41d0-4c6a-84f3-6232bdd7bdbe tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:54.652902 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-dec98a46-41d0-4c6a-84f3-6232bdd7bdbe tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1266 microversion: 2.1 time: 0.084465 May 13 17:27:54.654249 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 118/239] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:54 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:27:54.659976 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a346ce0a-15e9-4d4a-88b6-de07fbc9d5fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:54.668888 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a346ce0a-15e9-4d4a-88b6-de07fbc9d5fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:54.670583 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a346ce0a-15e9-4d4a-88b6-de07fbc9d5fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:54.671742 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a346ce0a-15e9-4d4a-88b6-de07fbc9d5fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.172329 May 13 17:27:54.672311 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 122/240] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:54 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:54.841865 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-63d73d13-796b-44f8-af47-a11155038c73 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:54.842606 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-63d73d13-796b-44f8-af47-a11155038c73 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:54.849361 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-63d73d13-796b-44f8-af47-a11155038c73 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:54.849819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-63d73d13-796b-44f8-af47-a11155038c73 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:54.850587 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-63d73d13-796b-44f8-af47-a11155038c73 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:54.851027 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-63d73d13-796b-44f8-af47-a11155038c73 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:54.986645 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-63d73d13-796b-44f8-af47-a11155038c73 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:54.994783 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-63d73d13-796b-44f8-af47-a11155038c73 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.156751 May 13 17:27:54.995406 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 119/241] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:54 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:55.671543 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-c635e2d8-a7e6-4f2f-a605-f8a86b8cc46e tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:55.672153 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-c635e2d8-a7e6-4f2f-a605-f8a86b8cc46e tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:55.678677 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c635e2d8-a7e6-4f2f-a605-f8a86b8cc46e tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:55.679148 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c635e2d8-a7e6-4f2f-a605-f8a86b8cc46e tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:55.679937 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c635e2d8-a7e6-4f2f-a605-f8a86b8cc46e tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:55.680375 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c635e2d8-a7e6-4f2f-a605-f8a86b8cc46e tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:55.693753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-41c01af9-63f6-4886-b9c0-ab9334af0391 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:55.694473 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-41c01af9-63f6-4886-b9c0-ab9334af0391 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:55.701355 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-41c01af9-63f6-4886-b9c0-ab9334af0391 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:55.704752 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-41c01af9-63f6-4886-b9c0-ab9334af0391 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:55.704752 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-41c01af9-63f6-4886-b9c0-ab9334af0391 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:55.704752 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-41c01af9-63f6-4886-b9c0-ab9334af0391 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:55.750646 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c635e2d8-a7e6-4f2f-a605-f8a86b8cc46e tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:55.757952 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-c635e2d8-a7e6-4f2f-a605-f8a86b8cc46e tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1266 microversion: 2.1 time: 0.090241 May 13 17:27:55.758866 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 123/242] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:55 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1266 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:55.839102 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-41c01af9-63f6-4886-b9c0-ab9334af0391 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:55.847867 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-41c01af9-63f6-4886-b9c0-ab9334af0391 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:55.849342 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-41c01af9-63f6-4886-b9c0-ab9334af0391 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:55.850428 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-41c01af9-63f6-4886-b9c0-ab9334af0391 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.160544 May 13 17:27:55.851069 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 120/243] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:55 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:27:56.012884 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-712b8b94-7bd9-4816-b992-5eb1e87fc487 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:56.013491 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-712b8b94-7bd9-4816-b992-5eb1e87fc487 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:56.020074 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-712b8b94-7bd9-4816-b992-5eb1e87fc487 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:56.021621 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-712b8b94-7bd9-4816-b992-5eb1e87fc487 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:56.021621 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-712b8b94-7bd9-4816-b992-5eb1e87fc487 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:56.021892 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-712b8b94-7bd9-4816-b992-5eb1e87fc487 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:56.150239 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-712b8b94-7bd9-4816-b992-5eb1e87fc487 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:56.157509 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-712b8b94-7bd9-4816-b992-5eb1e87fc487 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.148339 May 13 17:27:56.158154 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 124/244] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:56 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:56.774759 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8887a1a4-8913-48cf-8503-4b13b4bee32c tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:56.775405 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8887a1a4-8913-48cf-8503-4b13b4bee32c tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:56.781458 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8887a1a4-8913-48cf-8503-4b13b4bee32c tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:56.781913 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8887a1a4-8913-48cf-8503-4b13b4bee32c tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:56.782803 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8887a1a4-8913-48cf-8503-4b13b4bee32c tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:56.783189 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8887a1a4-8913-48cf-8503-4b13b4bee32c tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:56.847215 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8887a1a4-8913-48cf-8503-4b13b4bee32c tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:56.852021 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8887a1a4-8913-48cf-8503-4b13b4bee32c tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1266 microversion: 2.1 time: 0.080954 May 13 17:27:56.852648 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 121/245] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:56 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:56.867297 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b42aef79-87c6-49a5-99be-1e0ec2a2c7bb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:56.868054 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b42aef79-87c6-49a5-99be-1e0ec2a2c7bb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:56.875177 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b42aef79-87c6-49a5-99be-1e0ec2a2c7bb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:56.875177 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b42aef79-87c6-49a5-99be-1e0ec2a2c7bb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:56.875177 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b42aef79-87c6-49a5-99be-1e0ec2a2c7bb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:56.875465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b42aef79-87c6-49a5-99be-1e0ec2a2c7bb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:57.009887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b42aef79-87c6-49a5-99be-1e0ec2a2c7bb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:57.018629 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b42aef79-87c6-49a5-99be-1e0ec2a2c7bb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:57.020174 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b42aef79-87c6-49a5-99be-1e0ec2a2c7bb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:57.021275 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b42aef79-87c6-49a5-99be-1e0ec2a2c7bb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.157780 May 13 17:27:57.021830 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 125/246] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:56 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:57.174718 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-06063b70-f2cb-4411-afcb-7f1a673cfb56 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:57.175370 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-06063b70-f2cb-4411-afcb-7f1a673cfb56 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:57.181328 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-06063b70-f2cb-4411-afcb-7f1a673cfb56 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:57.181774 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-06063b70-f2cb-4411-afcb-7f1a673cfb56 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:57.182522 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-06063b70-f2cb-4411-afcb-7f1a673cfb56 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:57.182951 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-06063b70-f2cb-4411-afcb-7f1a673cfb56 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:57.309017 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-06063b70-f2cb-4411-afcb-7f1a673cfb56 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:57.317737 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-06063b70-f2cb-4411-afcb-7f1a673cfb56 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.146704 May 13 17:27:57.318293 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 122/247] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:57 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:57.869045 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-fd6c9659-4f33-4af7-8c76-fed6fd23c57d tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:57.870266 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-fd6c9659-4f33-4af7-8c76-fed6fd23c57d tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:57.875701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fd6c9659-4f33-4af7-8c76-fed6fd23c57d tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:57.876153 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fd6c9659-4f33-4af7-8c76-fed6fd23c57d tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:57.876955 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fd6c9659-4f33-4af7-8c76-fed6fd23c57d tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:57.877393 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fd6c9659-4f33-4af7-8c76-fed6fd23c57d tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:57.939438 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-fd6c9659-4f33-4af7-8c76-fed6fd23c57d tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:57.947147 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-fd6c9659-4f33-4af7-8c76-fed6fd23c57d tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1266 microversion: 2.1 time: 0.081945 May 13 17:27:57.947813 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 126/248] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:57 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:58.039593 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c98e50ef-700e-4d68-bdcc-abe765b24225 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:58.040322 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c98e50ef-700e-4d68-bdcc-abe765b24225 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:58.046186 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c98e50ef-700e-4d68-bdcc-abe765b24225 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:58.046675 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c98e50ef-700e-4d68-bdcc-abe765b24225 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:58.047482 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c98e50ef-700e-4d68-bdcc-abe765b24225 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:58.047922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c98e50ef-700e-4d68-bdcc-abe765b24225 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:58.176241 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c98e50ef-700e-4d68-bdcc-abe765b24225 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:58.184084 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c98e50ef-700e-4d68-bdcc-abe765b24225 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:58.185557 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c98e50ef-700e-4d68-bdcc-abe765b24225 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:58.186637 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c98e50ef-700e-4d68-bdcc-abe765b24225 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.150893 May 13 17:27:58.187216 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 123/249] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:58 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:58.333916 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-0b12b115-b2d5-480b-9708-486fbebb268c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:58.334531 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-0b12b115-b2d5-480b-9708-486fbebb268c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:58.340771 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0b12b115-b2d5-480b-9708-486fbebb268c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:58.341231 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0b12b115-b2d5-480b-9708-486fbebb268c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:58.342013 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0b12b115-b2d5-480b-9708-486fbebb268c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:58.342453 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0b12b115-b2d5-480b-9708-486fbebb268c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:58.494459 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0b12b115-b2d5-480b-9708-486fbebb268c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:58.502605 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-0b12b115-b2d5-480b-9708-486fbebb268c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.172617 May 13 17:27:58.503584 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 127/250] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:58 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:58.965091 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ffc4b91c-ab5f-4eff-a75d-03bb69cf4633 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:58.965845 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ffc4b91c-ab5f-4eff-a75d-03bb69cf4633 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:58.973401 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ffc4b91c-ab5f-4eff-a75d-03bb69cf4633 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:58.973857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ffc4b91c-ab5f-4eff-a75d-03bb69cf4633 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:58.974979 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ffc4b91c-ab5f-4eff-a75d-03bb69cf4633 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:58.975434 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ffc4b91c-ab5f-4eff-a75d-03bb69cf4633 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:59.057104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ffc4b91c-ab5f-4eff-a75d-03bb69cf4633 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:59.064641 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ffc4b91c-ab5f-4eff-a75d-03bb69cf4633 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1266 microversion: 2.1 time: 0.105181 May 13 17:27:59.065242 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 124/251] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:58 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:27:59.210042 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b463bdc9-2a6e-4321-99c5-ef13245a6683 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:59.215247 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b463bdc9-2a6e-4321-99c5-ef13245a6683 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:59.258179 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b463bdc9-2a6e-4321-99c5-ef13245a6683 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:59.258946 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b463bdc9-2a6e-4321-99c5-ef13245a6683 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:59.262139 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b463bdc9-2a6e-4321-99c5-ef13245a6683 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:59.262913 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b463bdc9-2a6e-4321-99c5-ef13245a6683 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:59.435247 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b463bdc9-2a6e-4321-99c5-ef13245a6683 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:59.443167 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b463bdc9-2a6e-4321-99c5-ef13245a6683 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:59.444656 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b463bdc9-2a6e-4321-99c5-ef13245a6683 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:59.452035 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b463bdc9-2a6e-4321-99c5-ef13245a6683 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1407 microversion: 2.20 time: 0.244925 May 13 17:27:59.452035 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 128/252] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:27:59 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1407 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:27:59.519975 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0d0cced4-b89a-44f2-9d97-205d579449be tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:27:59.520611 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0d0cced4-b89a-44f2-9d97-205d579449be tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:59.526381 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0d0cced4-b89a-44f2-9d97-205d579449be tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:59.526874 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0d0cced4-b89a-44f2-9d97-205d579449be tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:59.527725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0d0cced4-b89a-44f2-9d97-205d579449be tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:59.528163 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0d0cced4-b89a-44f2-9d97-205d579449be tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:59.662483 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0d0cced4-b89a-44f2-9d97-205d579449be tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:27:59.669766 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0d0cced4-b89a-44f2-9d97-205d579449be tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.154036 May 13 17:27:59.670951 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 125/253] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:27:59 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:27:59.832698 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f5ac5e5c-e941-4876-83f5-cd0ca9540985 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7f27aa53-6ede-4aa7-9f1d-da8a2ae84606"}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:27:59.834269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-f5ac5e5c-e941-4876-83f5-cd0ca9540985 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:27:59.840215 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f5ac5e5c-e941-4876-83f5-cd0ca9540985 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:59.840917 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f5ac5e5c-e941-4876-83f5-cd0ca9540985 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:27:59.841928 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f5ac5e5c-e941-4876-83f5-cd0ca9540985 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:27:59.842472 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f5ac5e5c-e941-4876-83f5-cd0ca9540985 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:00.082345 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-08956f13-1db9-41f2-83ee-4cec600dc0e6 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:00.083030 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-08956f13-1db9-41f2-83ee-4cec600dc0e6 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:00.090193 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-08956f13-1db9-41f2-83ee-4cec600dc0e6 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:00.090819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-08956f13-1db9-41f2-83ee-4cec600dc0e6 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:00.091977 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-08956f13-1db9-41f2-83ee-4cec600dc0e6 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:00.092567 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-08956f13-1db9-41f2-83ee-4cec600dc0e6 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:00.193320 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-08956f13-1db9-41f2-83ee-4cec600dc0e6 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:00.200662 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-08956f13-1db9-41f2-83ee-4cec600dc0e6 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1274 microversion: 2.1 time: 0.122889 May 13 17:28:00.201664 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 126/254] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:00 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1274 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:28:00.470425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-851b250f-5cd6-4843-96b3-362706862987 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:00.471033 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-851b250f-5cd6-4843-96b3-362706862987 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:00.477923 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-851b250f-5cd6-4843-96b3-362706862987 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:00.483474 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-851b250f-5cd6-4843-96b3-362706862987 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:00.483474 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-851b250f-5cd6-4843-96b3-362706862987 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:00.483474 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-851b250f-5cd6-4843-96b3-362706862987 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:00.714335 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-851b250f-5cd6-4843-96b3-362706862987 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:00.723541 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-851b250f-5cd6-4843-96b3-362706862987 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:00.725059 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-851b250f-5cd6-4843-96b3-362706862987 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:00.727029 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-851b250f-5cd6-4843-96b3-362706862987 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1599 microversion: 2.20 time: 0.261744 May 13 17:28:00.731963 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 127/255] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:28:00 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1599 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:28:00.743676 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a82fc2e1-421d-426b-ba16-f985bc222d8c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:00.745013 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a82fc2e1-421d-426b-ba16-f985bc222d8c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:00.752788 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a82fc2e1-421d-426b-ba16-f985bc222d8c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:00.753539 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a82fc2e1-421d-426b-ba16-f985bc222d8c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:00.754532 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a82fc2e1-421d-426b-ba16-f985bc222d8c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:00.755201 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a82fc2e1-421d-426b-ba16-f985bc222d8c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:00.895271 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a82fc2e1-421d-426b-ba16-f985bc222d8c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:00.902635 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a82fc2e1-421d-426b-ba16-f985bc222d8c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.165508 May 13 17:28:00.903232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 128/256] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:00 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:00.907774 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8b4776ba-d0ea-4257-baf2-3bf087e6e76e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:00.908266 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8b4776ba-d0ea-4257-baf2-3bf087e6e76e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:00.915700 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8b4776ba-d0ea-4257-baf2-3bf087e6e76e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:00.916175 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8b4776ba-d0ea-4257-baf2-3bf087e6e76e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:00.916939 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8b4776ba-d0ea-4257-baf2-3bf087e6e76e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:00.917376 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8b4776ba-d0ea-4257-baf2-3bf087e6e76e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:01.054899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8b4776ba-d0ea-4257-baf2-3bf087e6e76e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.150539 May 13 17:28:01.055823 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 129/257] 10.222.0.64 () {60 vars in 1315 bytes} [Fri May 13 17:28:00 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67/os-interface => generated 284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 17:28:01.217884 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0f17256a-991a-4319-905a-22eaea9bc469 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:01.218800 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0f17256a-991a-4319-905a-22eaea9bc469 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:01.229117 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0f17256a-991a-4319-905a-22eaea9bc469 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:01.229759 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0f17256a-991a-4319-905a-22eaea9bc469 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:01.230594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0f17256a-991a-4319-905a-22eaea9bc469 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:01.231479 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0f17256a-991a-4319-905a-22eaea9bc469 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:01.357227 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0f17256a-991a-4319-905a-22eaea9bc469 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:01.375232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0f17256a-991a-4319-905a-22eaea9bc469 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1272 microversion: 2.1 time: 0.161110 May 13 17:28:01.376492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 130/258] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:01 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1272 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:28:01.488973 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f5ac5e5c-e941-4876-83f5-cd0ca9540985 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "POST /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.660702 May 13 17:28:01.489591 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 129/259] 10.222.0.64 () {60 vars in 1322 bytes} [Fri May 13 17:27:59 2022] POST /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1/os-volume_attachments => generated 194 bytes in 1663 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:28:01.920339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b0d2cdf7-7923-4b38-b4ce-1fd39b2c731e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:01.921227 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b0d2cdf7-7923-4b38-b4ce-1fd39b2c731e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:01.928435 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b0d2cdf7-7923-4b38-b4ce-1fd39b2c731e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:01.928984 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b0d2cdf7-7923-4b38-b4ce-1fd39b2c731e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:01.929868 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b0d2cdf7-7923-4b38-b4ce-1fd39b2c731e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:01.930305 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b0d2cdf7-7923-4b38-b4ce-1fd39b2c731e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:02.235630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b0d2cdf7-7923-4b38-b4ce-1fd39b2c731e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:02.243581 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b0d2cdf7-7923-4b38-b4ce-1fd39b2c731e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1364 microversion: 2.1 time: 0.327206 May 13 17:28:02.244164 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 131/260] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:01 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1364 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:02.393975 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-718cae39-2bdc-48fd-ba3d-e1681ec420d6 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:02.394806 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-718cae39-2bdc-48fd-ba3d-e1681ec420d6 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:02.401639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-718cae39-2bdc-48fd-ba3d-e1681ec420d6 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:02.402182 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-718cae39-2bdc-48fd-ba3d-e1681ec420d6 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:02.403047 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-718cae39-2bdc-48fd-ba3d-e1681ec420d6 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:02.403576 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-718cae39-2bdc-48fd-ba3d-e1681ec420d6 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:02.571967 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-718cae39-2bdc-48fd-ba3d-e1681ec420d6 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:02.581675 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-718cae39-2bdc-48fd-ba3d-e1681ec420d6 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1314 microversion: 2.1 time: 0.192462 May 13 17:28:02.582396 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 130/261] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:02 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:02.873885 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-22cd7cc6-3755-452f-89aa-8f0075ed7f40 req-f9363e81-ad7c-4625-b27e-48f4e9cf14fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "65fdbf1a-f080-4d79-b3f3-c465e5a81c67", "tag": "41053781-3367-4859-b7f7-eb83af021a82"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:28:02.889488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-22cd7cc6-3755-452f-89aa-8f0075ed7f40 req-f9363e81-ad7c-4625-b27e-48f4e9cf14fe service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:02.889940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-22cd7cc6-3755-452f-89aa-8f0075ed7f40 req-f9363e81-ad7c-4625-b27e-48f4e9cf14fe service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:02.902202 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-22cd7cc6-3755-452f-89aa-8f0075ed7f40 req-f9363e81-ad7c-4625-b27e-48f4e9cf14fe service nova] Creating event network-changed:41053781-3367-4859-b7f7-eb83af021a82 for instance 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 on hv-cinder-84178 May 13 17:28:02.912721 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-22cd7cc6-3755-452f-89aa-8f0075ed7f40 req-f9363e81-ad7c-4625-b27e-48f4e9cf14fe service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043670 May 13 17:28:02.913250 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 132/262] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:28:03.261249 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-9b927368-7374-4b67-a007-040ea87d6f30 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:03.271378 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-9b927368-7374-4b67-a007-040ea87d6f30 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:03.272979 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9b927368-7374-4b67-a007-040ea87d6f30 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:03.273890 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9b927368-7374-4b67-a007-040ea87d6f30 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:03.275042 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9b927368-7374-4b67-a007-040ea87d6f30 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:03.275964 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9b927368-7374-4b67-a007-040ea87d6f30 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:03.445710 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-9b927368-7374-4b67-a007-040ea87d6f30 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:03.454749 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-9b927368-7374-4b67-a007-040ea87d6f30 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1549 microversion: 2.1 time: 0.198448 May 13 17:28:03.458216 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 131/263] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:03 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1549 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:03.475433 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0d9c042b-ff67-4663-a535-d60f1f01c267 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:03.476837 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0d9c042b-ff67-4663-a535-d60f1f01c267 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:03.486872 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0d9c042b-ff67-4663-a535-d60f1f01c267 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:03.488606 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0d9c042b-ff67-4663-a535-d60f1f01c267 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:03.489496 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0d9c042b-ff67-4663-a535-d60f1f01c267 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:03.489947 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0d9c042b-ff67-4663-a535-d60f1f01c267 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:03.599116 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1fc0e340-9d7b-46bc-ba8d-0dc1b489d6ee tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:03.599750 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-1fc0e340-9d7b-46bc-ba8d-0dc1b489d6ee tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:03.605955 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1fc0e340-9d7b-46bc-ba8d-0dc1b489d6ee tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:03.606407 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1fc0e340-9d7b-46bc-ba8d-0dc1b489d6ee tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:03.607232 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1fc0e340-9d7b-46bc-ba8d-0dc1b489d6ee tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:03.607874 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1fc0e340-9d7b-46bc-ba8d-0dc1b489d6ee tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:03.663503 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0d9c042b-ff67-4663-a535-d60f1f01c267 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.193332 May 13 17:28:03.671014 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 133/264] 10.222.0.64 () {58 vars in 1274 bytes} [Fri May 13 17:28:03 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48/os-interface => generated 284 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:28:04.127375 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-1fc0e340-9d7b-46bc-ba8d-0dc1b489d6ee tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:04.136075 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-1fc0e340-9d7b-46bc-ba8d-0dc1b489d6ee tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1314 microversion: 2.1 time: 0.541349 May 13 17:28:04.139857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 132/265] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:03 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:28:04.927850 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-d0c31e49-f885-4fd1-b0bf-cfcc5c4c974a req-107748ac-97d0-487a-a4a9-b142fbc05253 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dcaff61-29b7-43cb-9660-c12814b944e4", "tag": "8e955c84-bf6d-44ba-8103-100845d7c051"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:28:04.936793 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-d0c31e49-f885-4fd1-b0bf-cfcc5c4c974a req-107748ac-97d0-487a-a4a9-b142fbc05253 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:04.936938 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-d0c31e49-f885-4fd1-b0bf-cfcc5c4c974a req-107748ac-97d0-487a-a4a9-b142fbc05253 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:04.948181 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-d0c31e49-f885-4fd1-b0bf-cfcc5c4c974a req-107748ac-97d0-487a-a4a9-b142fbc05253 service nova] Creating event network-changed:8e955c84-bf6d-44ba-8103-100845d7c051 for instance 7dcaff61-29b7-43cb-9660-c12814b944e4 on hv-cinder-84178 May 13 17:28:04.959448 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-d0c31e49-f885-4fd1-b0bf-cfcc5c4c974a req-107748ac-97d0-487a-a4a9-b142fbc05253 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031382 May 13 17:28:04.959448 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 134/266] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:28:05.162158 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3d9f2e6c-a0fe-487d-b71d-967b75a2fd5a tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:05.162775 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3d9f2e6c-a0fe-487d-b71d-967b75a2fd5a tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:05.177056 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3d9f2e6c-a0fe-487d-b71d-967b75a2fd5a tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:05.177826 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3d9f2e6c-a0fe-487d-b71d-967b75a2fd5a tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:05.178818 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3d9f2e6c-a0fe-487d-b71d-967b75a2fd5a tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:05.179494 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3d9f2e6c-a0fe-487d-b71d-967b75a2fd5a tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:05.423912 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3d9f2e6c-a0fe-487d-b71d-967b75a2fd5a tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:05.431347 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3d9f2e6c-a0fe-487d-b71d-967b75a2fd5a tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1314 microversion: 2.1 time: 0.277336 May 13 17:28:05.431935 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 133/267] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:05 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:06.155328 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-99b73e52-d5e2-48a3-b54e-1e79c110d510 req-9b78e0d4-7656-44ac-a485-ab19f31ada03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a72fdd8-ca24-4ae1-b007-7e22f411ad48", "tag": "65e4c296-6b3c-4eb9-a923-4c5f6eab3710"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:28:06.164642 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-99b73e52-d5e2-48a3-b54e-1e79c110d510 req-9b78e0d4-7656-44ac-a485-ab19f31ada03 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:06.165083 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-99b73e52-d5e2-48a3-b54e-1e79c110d510 req-9b78e0d4-7656-44ac-a485-ab19f31ada03 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:06.176116 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-99b73e52-d5e2-48a3-b54e-1e79c110d510 req-9b78e0d4-7656-44ac-a485-ab19f31ada03 service nova] Creating event network-changed:65e4c296-6b3c-4eb9-a923-4c5f6eab3710 for instance 9a72fdd8-ca24-4ae1-b007-7e22f411ad48 on hv-cinder-84178 May 13 17:28:06.180965 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-99b73e52-d5e2-48a3-b54e-1e79c110d510 req-9b78e0d4-7656-44ac-a485-ab19f31ada03 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085470 May 13 17:28:06.181559 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 135/268] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:28:06.449424 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6eb309c9-a72b-43cf-abd0-562a9640f01d tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:06.450989 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6eb309c9-a72b-43cf-abd0-562a9640f01d tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:06.459283 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6eb309c9-a72b-43cf-abd0-562a9640f01d tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:06.459769 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6eb309c9-a72b-43cf-abd0-562a9640f01d tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:06.460782 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6eb309c9-a72b-43cf-abd0-562a9640f01d tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:06.461229 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6eb309c9-a72b-43cf-abd0-562a9640f01d tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:06.629888 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6eb309c9-a72b-43cf-abd0-562a9640f01d tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:06.644054 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6eb309c9-a72b-43cf-abd0-562a9640f01d tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1314 microversion: 2.1 time: 0.194172 May 13 17:28:06.644672 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 134/269] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:06 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:07.661435 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ce5e404e-3886-4b02-aae2-df3149a4c330 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:07.662128 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ce5e404e-3886-4b02-aae2-df3149a4c330 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:07.668566 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ce5e404e-3886-4b02-aae2-df3149a4c330 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:07.669145 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ce5e404e-3886-4b02-aae2-df3149a4c330 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:07.670020 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ce5e404e-3886-4b02-aae2-df3149a4c330 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:07.670512 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ce5e404e-3886-4b02-aae2-df3149a4c330 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:07.821274 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ce5e404e-3886-4b02-aae2-df3149a4c330 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:07.833719 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ce5e404e-3886-4b02-aae2-df3149a4c330 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1314 microversion: 2.1 time: 0.174022 May 13 17:28:07.834534 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 136/270] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:07 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:08.852448 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7bee9ca1-0e2e-4e24-9c25-ccb1428d27c5 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:08.853054 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7bee9ca1-0e2e-4e24-9c25-ccb1428d27c5 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:08.860465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7bee9ca1-0e2e-4e24-9c25-ccb1428d27c5 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:08.861094 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7bee9ca1-0e2e-4e24-9c25-ccb1428d27c5 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:08.863069 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7bee9ca1-0e2e-4e24-9c25-ccb1428d27c5 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:08.863069 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7bee9ca1-0e2e-4e24-9c25-ccb1428d27c5 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:08.991961 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7bee9ca1-0e2e-4e24-9c25-ccb1428d27c5 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:09.002207 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7bee9ca1-0e2e-4e24-9c25-ccb1428d27c5 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1314 microversion: 2.1 time: 0.154127 May 13 17:28:09.002829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 135/271] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:08 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:10.019356 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ce1c7b1e-7983-4c12-89d2-f4cd98ae76d4 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:10.020108 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ce1c7b1e-7983-4c12-89d2-f4cd98ae76d4 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:10.025995 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ce1c7b1e-7983-4c12-89d2-f4cd98ae76d4 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:10.026450 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ce1c7b1e-7983-4c12-89d2-f4cd98ae76d4 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:10.027245 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ce1c7b1e-7983-4c12-89d2-f4cd98ae76d4 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:10.027688 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ce1c7b1e-7983-4c12-89d2-f4cd98ae76d4 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:10.184680 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ce1c7b1e-7983-4c12-89d2-f4cd98ae76d4 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:10.192857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ce1c7b1e-7983-4c12-89d2-f4cd98ae76d4 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1314 microversion: 2.1 time: 0.178326 May 13 17:28:10.193388 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 137/272] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:10 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:11.215955 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-50d98226-1849-4535-bbd9-375eacebe626 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:11.216578 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-50d98226-1849-4535-bbd9-375eacebe626 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:11.223885 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-50d98226-1849-4535-bbd9-375eacebe626 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:11.224339 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-50d98226-1849-4535-bbd9-375eacebe626 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:11.225118 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-50d98226-1849-4535-bbd9-375eacebe626 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:11.225560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-50d98226-1849-4535-bbd9-375eacebe626 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:11.396989 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-50d98226-1849-4535-bbd9-375eacebe626 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:11.405066 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-50d98226-1849-4535-bbd9-375eacebe626 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1314 microversion: 2.1 time: 0.199099 May 13 17:28:11.405650 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 136/273] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:11 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:12.430314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2d05c79b-8111-463d-b5c3-a845a1972f17 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:12.430950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2d05c79b-8111-463d-b5c3-a845a1972f17 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:12.436959 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2d05c79b-8111-463d-b5c3-a845a1972f17 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:12.437410 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2d05c79b-8111-463d-b5c3-a845a1972f17 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:12.438170 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2d05c79b-8111-463d-b5c3-a845a1972f17 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:12.438606 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2d05c79b-8111-463d-b5c3-a845a1972f17 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:12.572097 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2d05c79b-8111-463d-b5c3-a845a1972f17 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:12.579242 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2d05c79b-8111-463d-b5c3-a845a1972f17 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1314 microversion: 2.1 time: 0.152534 May 13 17:28:12.579701 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 138/274] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:12 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:13.598329 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3ad570b4-641f-4955-835a-a51859a17570 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:13.599573 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3ad570b4-641f-4955-835a-a51859a17570 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:13.606882 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3ad570b4-641f-4955-835a-a51859a17570 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:13.607378 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3ad570b4-641f-4955-835a-a51859a17570 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:13.608216 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3ad570b4-641f-4955-835a-a51859a17570 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:13.608801 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3ad570b4-641f-4955-835a-a51859a17570 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:13.793601 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3ad570b4-641f-4955-835a-a51859a17570 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:13.801337 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3ad570b4-641f-4955-835a-a51859a17570 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1314 microversion: 2.1 time: 0.209706 May 13 17:28:13.802197 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 137/275] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:13 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1314 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:14.821559 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f577440b-631d-46be-8e5f-a1ea455adce7 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:14.823525 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f577440b-631d-46be-8e5f-a1ea455adce7 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:14.828102 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f577440b-631d-46be-8e5f-a1ea455adce7 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:14.828788 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f577440b-631d-46be-8e5f-a1ea455adce7 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:14.829726 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f577440b-631d-46be-8e5f-a1ea455adce7 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:14.830304 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f577440b-631d-46be-8e5f-a1ea455adce7 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:14.984743 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f577440b-631d-46be-8e5f-a1ea455adce7 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:15.003288 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f577440b-631d-46be-8e5f-a1ea455adce7 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1314 microversion: 2.1 time: 0.182238 May 13 17:28:15.003288 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 139/276] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:14 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:15.076786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-4c777a7d-e80f-4d3a-8114-1fe7c68e7b52 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:15.077501 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-4c777a7d-e80f-4d3a-8114-1fe7c68e7b52 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:15.085019 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4c777a7d-e80f-4d3a-8114-1fe7c68e7b52 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:15.085554 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4c777a7d-e80f-4d3a-8114-1fe7c68e7b52 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:15.086445 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4c777a7d-e80f-4d3a-8114-1fe7c68e7b52 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:15.087143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4c777a7d-e80f-4d3a-8114-1fe7c68e7b52 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:15.119916 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-4c777a7d-e80f-4d3a-8114-1fe7c68e7b52 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Going to try to terminate instance {{(pid=117492) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 17:28:15.717309 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-4c777a7d-e80f-4d3a-8114-1fe7c68e7b52 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 204 len: 0 microversion: 2.1 time: 0.644326 May 13 17:28:15.721663 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 138/277] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:28:15 2022] DELETE /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 17:28:15.732922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9f066bd1-4dca-4440-8b4e-e1eb1c316d7d tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:15.732922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9f066bd1-4dca-4440-8b4e-e1eb1c316d7d tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:15.737529 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9f066bd1-4dca-4440-8b4e-e1eb1c316d7d tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:15.738221 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9f066bd1-4dca-4440-8b4e-e1eb1c316d7d tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:15.739360 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9f066bd1-4dca-4440-8b4e-e1eb1c316d7d tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:15.740025 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9f066bd1-4dca-4440-8b4e-e1eb1c316d7d tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:15.877961 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9f066bd1-4dca-4440-8b4e-e1eb1c316d7d tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:15.887317 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9f066bd1-4dca-4440-8b4e-e1eb1c316d7d tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1552 microversion: 2.1 time: 0.162450 May 13 17:28:15.896575 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 140/278] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:15 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1552 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:16.014276 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-5018a8e5-8fb9-4a53-92cc-2233b1c591c2 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:16.014979 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-5018a8e5-8fb9-4a53-92cc-2233b1c591c2 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:16.021076 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5018a8e5-8fb9-4a53-92cc-2233b1c591c2 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:16.021732 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5018a8e5-8fb9-4a53-92cc-2233b1c591c2 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:16.022295 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5018a8e5-8fb9-4a53-92cc-2233b1c591c2 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:16.022726 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5018a8e5-8fb9-4a53-92cc-2233b1c591c2 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:16.079074 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-359448f9-c825-4967-8ce9-da0c31a3f737 req-07dc94aa-4f84-4ccf-a60d-b47dc5b10cdc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dcaff61-29b7-43cb-9660-c12814b944e4", "name": "network-vif-plugged", "status": "completed", "tag": "8e955c84-bf6d-44ba-8103-100845d7c051"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:28:16.093498 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-359448f9-c825-4967-8ce9-da0c31a3f737 req-07dc94aa-4f84-4ccf-a60d-b47dc5b10cdc service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:16.094486 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-359448f9-c825-4967-8ce9-da0c31a3f737 req-07dc94aa-4f84-4ccf-a60d-b47dc5b10cdc service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:16.108161 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-359448f9-c825-4967-8ce9-da0c31a3f737 req-07dc94aa-4f84-4ccf-a60d-b47dc5b10cdc service nova] Creating event network-vif-plugged:8e955c84-bf6d-44ba-8103-100845d7c051 for instance 7dcaff61-29b7-43cb-9660-c12814b944e4 on hv-cinder-84178 May 13 17:28:16.115597 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-359448f9-c825-4967-8ce9-da0c31a3f737 req-07dc94aa-4f84-4ccf-a60d-b47dc5b10cdc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040931 May 13 17:28:16.116859 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 141/279] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:28:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:28:16.194374 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-5018a8e5-8fb9-4a53-92cc-2233b1c591c2 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:16.202049 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-5018a8e5-8fb9-4a53-92cc-2233b1c591c2 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1314 microversion: 2.1 time: 0.191932 May 13 17:28:16.202772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 139/280] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:16 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:16.904093 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-52dd1c41-5b9f-4d0c-bf4c-df0a24d63fb9 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:16.904780 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-52dd1c41-5b9f-4d0c-bf4c-df0a24d63fb9 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:16.911670 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-52dd1c41-5b9f-4d0c-bf4c-df0a24d63fb9 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:16.912050 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-52dd1c41-5b9f-4d0c-bf4c-df0a24d63fb9 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:16.912672 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-52dd1c41-5b9f-4d0c-bf4c-df0a24d63fb9 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:16.913099 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-52dd1c41-5b9f-4d0c-bf4c-df0a24d63fb9 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:17.049532 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-52dd1c41-5b9f-4d0c-bf4c-df0a24d63fb9 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:17.058532 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-52dd1c41-5b9f-4d0c-bf4c-df0a24d63fb9 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1552 microversion: 2.1 time: 0.158433 May 13 17:28:17.063341 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 142/281] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:16 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1552 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:17.217970 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-80244f61-0465-4480-b823-b2b0dc417616 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:17.218961 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-80244f61-0465-4480-b823-b2b0dc417616 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:17.225439 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-80244f61-0465-4480-b823-b2b0dc417616 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:17.225884 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-80244f61-0465-4480-b823-b2b0dc417616 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:17.226659 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-80244f61-0465-4480-b823-b2b0dc417616 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:17.227104 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-80244f61-0465-4480-b823-b2b0dc417616 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:17.364360 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-80244f61-0465-4480-b823-b2b0dc417616 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:17.371692 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-80244f61-0465-4480-b823-b2b0dc417616 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1314 microversion: 2.1 time: 0.157585 May 13 17:28:17.372264 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 140/282] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:17 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:18.078664 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-79fbdd7a-50c4-4d8a-ae66-3e75a9d43c12 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:18.079304 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-79fbdd7a-50c4-4d8a-ae66-3e75a9d43c12 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:18.085564 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-79fbdd7a-50c4-4d8a-ae66-3e75a9d43c12 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:18.086127 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-79fbdd7a-50c4-4d8a-ae66-3e75a9d43c12 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:18.086919 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-79fbdd7a-50c4-4d8a-ae66-3e75a9d43c12 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:18.087386 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-79fbdd7a-50c4-4d8a-ae66-3e75a9d43c12 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:18.283802 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-79fbdd7a-50c4-4d8a-ae66-3e75a9d43c12 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:18.294086 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-79fbdd7a-50c4-4d8a-ae66-3e75a9d43c12 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1552 microversion: 2.1 time: 0.219164 May 13 17:28:18.303964 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 143/283] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:18 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1552 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:18.389261 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-297f605f-ae31-4d9b-99cb-d958c00263e2 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:18.390434 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-297f605f-ae31-4d9b-99cb-d958c00263e2 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:18.396539 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-297f605f-ae31-4d9b-99cb-d958c00263e2 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:18.396997 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-297f605f-ae31-4d9b-99cb-d958c00263e2 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:18.397772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-297f605f-ae31-4d9b-99cb-d958c00263e2 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:18.398219 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-297f605f-ae31-4d9b-99cb-d958c00263e2 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:18.540737 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-297f605f-ae31-4d9b-99cb-d958c00263e2 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:18.548183 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-297f605f-ae31-4d9b-99cb-d958c00263e2 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1314 microversion: 2.1 time: 0.162858 May 13 17:28:18.548762 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 141/284] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:18 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:19.311790 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-bfcf43e9-3751-4b34-9a9e-80e2791e5701 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:19.313044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-bfcf43e9-3751-4b34-9a9e-80e2791e5701 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:19.320397 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bfcf43e9-3751-4b34-9a9e-80e2791e5701 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:19.328415 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bfcf43e9-3751-4b34-9a9e-80e2791e5701 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:19.328415 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bfcf43e9-3751-4b34-9a9e-80e2791e5701 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:19.328415 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bfcf43e9-3751-4b34-9a9e-80e2791e5701 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:19.477020 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-bfcf43e9-3751-4b34-9a9e-80e2791e5701 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:19.485039 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-bfcf43e9-3751-4b34-9a9e-80e2791e5701 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1552 microversion: 2.1 time: 0.177597 May 13 17:28:19.485614 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 144/285] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:19 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1552 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:19.565709 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-878f24f8-0c08-4316-a725-6439bd51104e tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:19.566568 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-878f24f8-0c08-4316-a725-6439bd51104e tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:19.578867 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-878f24f8-0c08-4316-a725-6439bd51104e tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:19.580026 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-878f24f8-0c08-4316-a725-6439bd51104e tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:19.580811 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-878f24f8-0c08-4316-a725-6439bd51104e tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:19.581253 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-878f24f8-0c08-4316-a725-6439bd51104e tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:19.741199 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-878f24f8-0c08-4316-a725-6439bd51104e tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:19.751491 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-878f24f8-0c08-4316-a725-6439bd51104e tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1314 microversion: 2.1 time: 0.189463 May 13 17:28:19.752079 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 142/286] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:19 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:20.208234 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-c89b20b2-39e9-4f18-a691-cf32c10e560c req-1beefef4-1ad9-42f6-b264-43f509b21117 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebfc247d-ad6b-43f7-adec-b9054fefa3a1", "name": "network-vif-deleted", "tag": "52e61d3c-72e9-427b-ac8a-8ad080ce50d0"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:28:20.215923 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-c89b20b2-39e9-4f18-a691-cf32c10e560c req-1beefef4-1ad9-42f6-b264-43f509b21117 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:20.216370 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-c89b20b2-39e9-4f18-a691-cf32c10e560c req-1beefef4-1ad9-42f6-b264-43f509b21117 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:20.228183 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-c89b20b2-39e9-4f18-a691-cf32c10e560c req-1beefef4-1ad9-42f6-b264-43f509b21117 service nova] Creating event network-vif-deleted:52e61d3c-72e9-427b-ac8a-8ad080ce50d0 for instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 on hv-cinder-84178 May 13 17:28:20.232973 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-c89b20b2-39e9-4f18-a691-cf32c10e560c req-1beefef4-1ad9-42f6-b264-43f509b21117 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028911 May 13 17:28:20.233577 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 145/287] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:28:20.504771 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-818cc320-78f8-421c-973f-c2d587c15baa tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:20.505369 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-818cc320-78f8-421c-973f-c2d587c15baa tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:20.511117 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-818cc320-78f8-421c-973f-c2d587c15baa tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:20.511594 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-818cc320-78f8-421c-973f-c2d587c15baa tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:20.512357 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-818cc320-78f8-421c-973f-c2d587c15baa tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:20.512801 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-818cc320-78f8-421c-973f-c2d587c15baa tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:20.575913 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-818cc320-78f8-421c-973f-c2d587c15baa tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:20.585284 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-818cc320-78f8-421c-973f-c2d587c15baa tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1510 microversion: 2.1 time: 0.084854 May 13 17:28:20.585857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 143/288] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:20 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1510 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:28:20.771366 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-834b84ba-84b4-45d7-83b4-dc3ff0d3bf0b tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:20.772335 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-834b84ba-84b4-45d7-83b4-dc3ff0d3bf0b tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:20.779695 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-834b84ba-84b4-45d7-83b4-dc3ff0d3bf0b tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:20.780143 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-834b84ba-84b4-45d7-83b4-dc3ff0d3bf0b tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:20.780904 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-834b84ba-84b4-45d7-83b4-dc3ff0d3bf0b tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:20.781450 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-834b84ba-84b4-45d7-83b4-dc3ff0d3bf0b tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:20.918355 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-834b84ba-84b4-45d7-83b4-dc3ff0d3bf0b tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:20.927984 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-834b84ba-84b4-45d7-83b4-dc3ff0d3bf0b tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1464 microversion: 2.1 time: 0.159694 May 13 17:28:20.927984 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 146/289] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:20 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1464 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:20.967766 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-36fb3526-f691-4333-a78f-d7ea7c92b5ac tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:20.968983 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-36fb3526-f691-4333-a78f-d7ea7c92b5ac tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:20.976116 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-36fb3526-f691-4333-a78f-d7ea7c92b5ac tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:20.976703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-36fb3526-f691-4333-a78f-d7ea7c92b5ac tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:20.977930 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-36fb3526-f691-4333-a78f-d7ea7c92b5ac tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:20.978115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-36fb3526-f691-4333-a78f-d7ea7c92b5ac tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:21.007938 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-36fb3526-f691-4333-a78f-d7ea7c92b5ac tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Going to try to terminate instance {{(pid=117492) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 17:28:21.301494 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-36fb3526-f691-4333-a78f-d7ea7c92b5ac tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "DELETE /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 204 len: 0 microversion: 2.1 time: 0.338738 May 13 17:28:21.302211 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 144/290] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:28:20 2022] DELETE /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 17:28:21.310417 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-61eda7fe-4c1a-47f1-bcdd-e822abc43dcc tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:21.311033 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-61eda7fe-4c1a-47f1-bcdd-e822abc43dcc tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:21.317256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61eda7fe-4c1a-47f1-bcdd-e822abc43dcc tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:21.317703 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61eda7fe-4c1a-47f1-bcdd-e822abc43dcc tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:21.318476 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61eda7fe-4c1a-47f1-bcdd-e822abc43dcc tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:21.318917 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61eda7fe-4c1a-47f1-bcdd-e822abc43dcc tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:21.468158 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-61eda7fe-4c1a-47f1-bcdd-e822abc43dcc tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:21.476842 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-61eda7fe-4c1a-47f1-bcdd-e822abc43dcc tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1470 microversion: 2.1 time: 0.170372 May 13 17:28:21.484787 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 147/291] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:21 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1470 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:21.603191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-5da473b2-dd19-4fb6-a1b8-a385d98ded72 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:21.603894 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-5da473b2-dd19-4fb6-a1b8-a385d98ded72 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:21.610140 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5da473b2-dd19-4fb6-a1b8-a385d98ded72 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:21.610601 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5da473b2-dd19-4fb6-a1b8-a385d98ded72 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:21.611440 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5da473b2-dd19-4fb6-a1b8-a385d98ded72 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:21.611882 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5da473b2-dd19-4fb6-a1b8-a385d98ded72 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:21.642836 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5da473b2-dd19-4fb6-a1b8-a385d98ded72 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:21.643328 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5da473b2-dd19-4fb6-a1b8-a385d98ded72 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:21.643795 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.objects.instance [None req-5da473b2-dd19-4fb6-a1b8-a385d98ded72 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lazy-loading 'fault' on Instance uuid ebfc247d-ad6b-43f7-adec-b9054fefa3a1 {{(pid=117492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:28:21.688348 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-5da473b2-dd19-4fb6-a1b8-a385d98ded72 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:21.696371 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-5da473b2-dd19-4fb6-a1b8-a385d98ded72 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1351 microversion: 2.1 time: 0.097432 May 13 17:28:21.696949 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 145/292] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:21 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:22.494175 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f3da41a1-86fa-4801-9e9c-38eacc67c299 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:22.494796 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f3da41a1-86fa-4801-9e9c-38eacc67c299 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:22.500621 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f3da41a1-86fa-4801-9e9c-38eacc67c299 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:22.501061 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f3da41a1-86fa-4801-9e9c-38eacc67c299 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:22.501813 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f3da41a1-86fa-4801-9e9c-38eacc67c299 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:22.502240 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f3da41a1-86fa-4801-9e9c-38eacc67c299 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:22.637677 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f3da41a1-86fa-4801-9e9c-38eacc67c299 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:22.645540 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f3da41a1-86fa-4801-9e9c-38eacc67c299 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1470 microversion: 2.1 time: 0.155156 May 13 17:28:22.646099 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 148/293] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:22 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:22.713626 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-37e4fc34-cbae-460b-9bd8-1d5840b35ec5 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:22.714251 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-37e4fc34-cbae-460b-9bd8-1d5840b35ec5 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:22.721160 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-37e4fc34-cbae-460b-9bd8-1d5840b35ec5 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:22.721613 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-37e4fc34-cbae-460b-9bd8-1d5840b35ec5 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:22.723079 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-37e4fc34-cbae-460b-9bd8-1d5840b35ec5 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:22.723548 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-37e4fc34-cbae-460b-9bd8-1d5840b35ec5 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:22.754839 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-37e4fc34-cbae-460b-9bd8-1d5840b35ec5 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:22.755332 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-37e4fc34-cbae-460b-9bd8-1d5840b35ec5 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:22.755786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.objects.instance [None req-37e4fc34-cbae-460b-9bd8-1d5840b35ec5 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lazy-loading 'fault' on Instance uuid ebfc247d-ad6b-43f7-adec-b9054fefa3a1 {{(pid=117492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:28:22.798793 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-37e4fc34-cbae-460b-9bd8-1d5840b35ec5 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af2ddeccca5547bfa8ad3804e9041b65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7123f57c394d4a35b46f5bf62d48abb7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:22.806685 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-37e4fc34-cbae-460b-9bd8-1d5840b35ec5 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 200 len: 1351 microversion: 2.1 time: 0.096954 May 13 17:28:22.807283 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 146/294] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:22 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 1351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:23.661630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6635cce9-e913-4de9-b506-0d7e1ee9e41f tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:23.662246 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6635cce9-e913-4de9-b506-0d7e1ee9e41f tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:23.672774 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6635cce9-e913-4de9-b506-0d7e1ee9e41f tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:23.673244 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6635cce9-e913-4de9-b506-0d7e1ee9e41f tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:23.674054 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6635cce9-e913-4de9-b506-0d7e1ee9e41f tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:23.674458 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6635cce9-e913-4de9-b506-0d7e1ee9e41f tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:23.836963 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f608df76-02ab-4c91-ad15-790917670de3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:23.839351 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-f608df76-02ab-4c91-ad15-790917670de3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:23.853901 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f608df76-02ab-4c91-ad15-790917670de3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:23.855056 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f608df76-02ab-4c91-ad15-790917670de3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:23.856289 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f608df76-02ab-4c91-ad15-790917670de3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:23.856887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f608df76-02ab-4c91-ad15-790917670de3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:23.872853 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-f608df76-02ab-4c91-ad15-790917670de3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] HTTP exception thrown: Instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 could not be found. May 13 17:28:23.877786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f608df76-02ab-4c91-ad15-790917670de3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Request method failure captured: May 13 17:28:23.877786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 HTTP/1.1 May 13 17:28:23.877786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:28:23.877786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:28:23.877786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:28:23.877786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 0 May 13 17:28:23.877786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:28:23.877786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:28:23.877786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:28:23.877786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:28:23.877786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpTSoB9mNleMeSzUttw1Ib3bXItSauEkTAWYS_K3_ujg5FI3lXO9r0-MBWptjoj07LqVCHbJ8ngm5DYxLo0t0uf3QyDbxnyJFB_dnlnsTi1G0yHzmfoPnqDwXhQCpBYKKCni91qK9vlaWUbxleSyaAzxn6HjLRuEWI3HxU_nj6o0aMc May 13 17:28:23.877786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:28:23.877786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:28:23.877786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:28:23.877786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:28:23.877786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:28:23.877786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:28:23.877786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: 7123f57c394d4a35b46f5bf62d48abb7 May 13 17:28:23.877786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-DeleteServersTestJSON-2110234141 May 13 17:28:23.877786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:28:23.877786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:28:23.879710 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/7123f57c394d4a35b46f5bf62d48abb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7123f57c394d4a35b46f5bf62d48abb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_7123f57c394d4a35b46f5bf62d48abb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7123f57c394d4a35b46f5bf62d48abb7"}]}] May 13 17:28:23.879710 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-DeleteServersTestJSON-2110234141 May 13 17:28:23.879710 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: 7123f57c394d4a35b46f5bf62d48abb7 May 13 17:28:23.879710 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-DeleteServersTestJSON-2110234141 May 13 17:28:23.879710 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-DeleteServersTestJSON-2110234141-project May 13 17:28:23.879710 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:28:23.879710 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:28:23.879710 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: af2ddeccca5547bfa8ad3804e9041b65 May 13 17:28:23.879710 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-DeleteServersTestJSON-2110234141-project May 13 17:28:23.879710 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: > May 13 17:28:23.879710 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 could not be found. May 13 17:28:23.879710 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'id': 'ebfc247d-ad6b-43f7-adec-b9054fefa3a1'} May 13 17:28:23.880586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:28:23.880586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:28:23.880586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:28:23.880586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:28:23.880586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:28:23.880586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:28:23.880586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:28:23.880586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:28:23.880586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:28:23.880586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:28:23.880586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 could not be found. May 13 17:28:23.880586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:28:23.880586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:28:23.880586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:28:23.880586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:28:23.880586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:28:23.880586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:28:23.880586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:28:23.880586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:28:23.880586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:28:23.881961 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:28:23.881961 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:28:23.881961 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:28:23.881961 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:28:23.881961 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:28:23.881961 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:28:23.881961 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:28:23.881961 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 could not be found. May 13 17:28:23.881961 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:28:23.881961 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:28:23.881961 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:28:23.881961 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:28:23.881961 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:28:23.881961 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:28:23.881961 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:28:23.881961 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:28:23.881961 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 could not be found. May 13 17:28:23.881961 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:28:23.884682 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f608df76-02ab-4c91-ad15-790917670de3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Returning 404 to user: Instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 could not be found. {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:28:23.885569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f608df76-02ab-4c91-ad15-790917670de3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 404 len: 111 microversion: 2.1 time: 0.065948 May 13 17:28:23.886144 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 147/295] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:23 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 17:28:23.993483 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-4b4d68d7-e9dd-4498-9d75-7f211730b7aa tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:23.996852 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-4b4d68d7-e9dd-4498-9d75-7f211730b7aa tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:24.002843 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4b4d68d7-e9dd-4498-9d75-7f211730b7aa tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:24.003400 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4b4d68d7-e9dd-4498-9d75-7f211730b7aa tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:24.004859 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4b4d68d7-e9dd-4498-9d75-7f211730b7aa tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:24.005683 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4b4d68d7-e9dd-4498-9d75-7f211730b7aa tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:24.022330 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-4b4d68d7-e9dd-4498-9d75-7f211730b7aa tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] HTTP exception thrown: Instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 could not be found. May 13 17:28:24.022897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-4b4d68d7-e9dd-4498-9d75-7f211730b7aa tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Request method failure captured: May 13 17:28:24.022897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1/os-volume_attachments HTTP/1.1 May 13 17:28:24.022897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:28:24.022897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:28:24.022897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:28:24.022897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 0 May 13 17:28:24.022897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:28:24.022897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:28:24.022897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:28:24.022897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:28:24.022897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpTSoB9mNleMeSzUttw1Ib3bXItSauEkTAWYS_K3_ujg5FI3lXO9r0-MBWptjoj07LqVCHbJ8ngm5DYxLo0t0uf3QyDbxnyJFB_dnlnsTi1G0yHzmfoPnqDwXhQCpBYKKCni91qK9vlaWUbxleSyaAzxn6HjLRuEWI3HxU_nj6o0aMc May 13 17:28:24.022897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:28:24.022897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:28:24.022897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:28:24.022897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:28:24.022897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:28:24.022897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:28:24.022897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: 7123f57c394d4a35b46f5bf62d48abb7 May 13 17:28:24.022897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-DeleteServersTestJSON-2110234141 May 13 17:28:24.022897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:28:24.022897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:28:24.024105 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/7123f57c394d4a35b46f5bf62d48abb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7123f57c394d4a35b46f5bf62d48abb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_7123f57c394d4a35b46f5bf62d48abb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7123f57c394d4a35b46f5bf62d48abb7"}]}] May 13 17:28:24.024105 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-DeleteServersTestJSON-2110234141 May 13 17:28:24.024105 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: 7123f57c394d4a35b46f5bf62d48abb7 May 13 17:28:24.024105 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-DeleteServersTestJSON-2110234141 May 13 17:28:24.024105 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-DeleteServersTestJSON-2110234141-project May 13 17:28:24.024105 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:28:24.024105 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:28:24.024105 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: af2ddeccca5547bfa8ad3804e9041b65 May 13 17:28:24.024105 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-DeleteServersTestJSON-2110234141-project May 13 17:28:24.024105 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: > May 13 17:28:24.024105 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 could not be found. May 13 17:28:24.024105 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'server_id': 'ebfc247d-ad6b-43f7-adec-b9054fefa3a1'} May 13 17:28:24.024842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:28:24.024842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:28:24.024842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:28:24.024842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:28:24.024842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:28:24.024842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:28:24.024842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:28:24.024842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:28:24.024842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:28:24.024842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:28:24.024842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 could not be found. May 13 17:28:24.024842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:28:24.024842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:28:24.024842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:28:24.024842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:28:24.024842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:28:24.024842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:28:24.024842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:28:24.024842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:28:24.024842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:28:24.025883 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:28:24.025883 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 13 17:28:24.025883 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 17:28:24.025883 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 13 17:28:24.025883 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 17:28:24.025883 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 13 17:28:24.025883 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 13 17:28:24.025883 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:28:24.025883 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:28:24.025883 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 could not be found. May 13 17:28:24.025883 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:28:24.025883 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:28:24.025883 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:28:24.025883 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:28:24.025883 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:28:24.025883 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:28:24.025883 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:28:24.025883 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:28:24.025883 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 could not be found. May 13 17:28:24.025883 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:28:24.031259 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-4b4d68d7-e9dd-4498-9d75-7f211730b7aa tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Returning 404 to user: Instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 could not be found. {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:28:24.032322 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-4b4d68d7-e9dd-4498-9d75-7f211730b7aa tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043125 May 13 17:28:24.033453 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 148/296] 10.222.0.64 () {58 vars in 1301 bytes} [Fri May 13 17:28:23 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 17:28:24.108517 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-5f79dbbc-d9e0-4dde-b4fe-76907303fd11 req-82a9d92d-9d96-451e-a839-35b8cdf95748 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dcaff61-29b7-43cb-9660-c12814b944e4", "name": "network-vif-deleted", "tag": "8e955c84-bf6d-44ba-8103-100845d7c051"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:28:24.118275 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6635cce9-e913-4de9-b506-0d7e1ee9e41f tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:24.125512 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-5f79dbbc-d9e0-4dde-b4fe-76907303fd11 req-82a9d92d-9d96-451e-a839-35b8cdf95748 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:24.126188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-5f79dbbc-d9e0-4dde-b4fe-76907303fd11 req-82a9d92d-9d96-451e-a839-35b8cdf95748 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:24.127344 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6635cce9-e913-4de9-b506-0d7e1ee9e41f tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1470 microversion: 2.1 time: 0.469518 May 13 17:28:24.127924 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 149/297] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:23 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1470 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:24.146912 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-5f79dbbc-d9e0-4dde-b4fe-76907303fd11 req-82a9d92d-9d96-451e-a839-35b8cdf95748 service nova] Creating event network-vif-deleted:8e955c84-bf6d-44ba-8103-100845d7c051 for instance 7dcaff61-29b7-43cb-9660-c12814b944e4 on hv-cinder-84178 May 13 17:28:24.154167 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-5f79dbbc-d9e0-4dde-b4fe-76907303fd11 req-82a9d92d-9d96-451e-a839-35b8cdf95748 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060106 May 13 17:28:24.154987 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 149/298] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:28:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:28:25.144515 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6b7c457c-3ca1-4831-9bd2-c88283e9c3f0 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:25.145762 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6b7c457c-3ca1-4831-9bd2-c88283e9c3f0 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:25.151740 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b7c457c-3ca1-4831-9bd2-c88283e9c3f0 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:25.152225 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b7c457c-3ca1-4831-9bd2-c88283e9c3f0 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:25.152999 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b7c457c-3ca1-4831-9bd2-c88283e9c3f0 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:25.153432 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b7c457c-3ca1-4831-9bd2-c88283e9c3f0 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:25.185575 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b7c457c-3ca1-4831-9bd2-c88283e9c3f0 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:25.186032 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b7c457c-3ca1-4831-9bd2-c88283e9c3f0 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:25.186495 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-6b7c457c-3ca1-4831-9bd2-c88283e9c3f0 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lazy-loading 'fault' on Instance uuid 7dcaff61-29b7-43cb-9660-c12814b944e4 {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:28:25.237521 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6b7c457c-3ca1-4831-9bd2-c88283e9c3f0 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '10e55f76eeaa46928289da220ceca447', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1e8b971013bf492988f7119cf63c69bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:25.246530 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6b7c457c-3ca1-4831-9bd2-c88283e9c3f0 tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 200 len: 1304 microversion: 2.1 time: 0.105865 May 13 17:28:25.249048 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 150/299] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:25 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:25.440821 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-c5b9f335-7756-4d87-a1bd-c1a741664842 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:25.440821 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-c5b9f335-7756-4d87-a1bd-c1a741664842 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:25.449697 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c5b9f335-7756-4d87-a1bd-c1a741664842 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:25.450330 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c5b9f335-7756-4d87-a1bd-c1a741664842 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:25.451512 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c5b9f335-7756-4d87-a1bd-c1a741664842 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:25.452287 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c5b9f335-7756-4d87-a1bd-c1a741664842 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:25.482631 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-c5b9f335-7756-4d87-a1bd-c1a741664842 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] HTTP exception thrown: Instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 could not be found. May 13 17:28:25.484404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-c5b9f335-7756-4d87-a1bd-c1a741664842 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Request method failure captured: May 13 17:28:25.484404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: DELETE /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 HTTP/1.1 May 13 17:28:25.484404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:28:25.484404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:28:25.484404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:28:25.484404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 0 May 13 17:28:25.484404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:28:25.484404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:28:25.484404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:28:25.484404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:28:25.484404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpTSoB9mNleMeSzUttw1Ib3bXItSauEkTAWYS_K3_ujg5FI3lXO9r0-MBWptjoj07LqVCHbJ8ngm5DYxLo0t0uf3QyDbxnyJFB_dnlnsTi1G0yHzmfoPnqDwXhQCpBYKKCni91qK9vlaWUbxleSyaAzxn6HjLRuEWI3HxU_nj6o0aMc May 13 17:28:25.484404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:28:25.484404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:28:25.484404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:28:25.484404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:28:25.484404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:28:25.484404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:28:25.484404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: 7123f57c394d4a35b46f5bf62d48abb7 May 13 17:28:25.484404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-DeleteServersTestJSON-2110234141 May 13 17:28:25.484404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:28:25.484404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:28:25.485949 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/7123f57c394d4a35b46f5bf62d48abb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7123f57c394d4a35b46f5bf62d48abb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_7123f57c394d4a35b46f5bf62d48abb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7123f57c394d4a35b46f5bf62d48abb7"}]}] May 13 17:28:25.485949 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-DeleteServersTestJSON-2110234141 May 13 17:28:25.485949 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: 7123f57c394d4a35b46f5bf62d48abb7 May 13 17:28:25.485949 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-DeleteServersTestJSON-2110234141 May 13 17:28:25.485949 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-DeleteServersTestJSON-2110234141-project May 13 17:28:25.485949 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:28:25.485949 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:28:25.485949 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: af2ddeccca5547bfa8ad3804e9041b65 May 13 17:28:25.485949 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-DeleteServersTestJSON-2110234141-project May 13 17:28:25.485949 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: > May 13 17:28:25.485949 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 could not be found. May 13 17:28:25.485949 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'id': 'ebfc247d-ad6b-43f7-adec-b9054fefa3a1'} May 13 17:28:25.486670 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:28:25.486670 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:28:25.486670 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:28:25.486670 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:28:25.486670 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:28:25.486670 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:28:25.486670 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:28:25.486670 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:28:25.486670 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:28:25.486670 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:28:25.486670 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 could not be found. May 13 17:28:25.486670 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:28:25.486670 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:28:25.486670 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:28:25.486670 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:28:25.486670 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:28:25.486670 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:28:25.486670 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:28:25.486670 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:28:25.486670 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:28:25.487977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:28:25.487977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 17:28:25.487977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 17:28:25.487977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 17:28:25.487977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 17:28:25.487977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:28:25.487977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:28:25.487977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:28:25.487977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:28:25.487977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 could not be found. May 13 17:28:25.487977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:28:25.487977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:28:25.487977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:28:25.487977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:28:25.487977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:28:25.487977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:28:25.487977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:28:25.487977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:28:25.487977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 could not be found. May 13 17:28:25.487977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:28:25.489282 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-c5b9f335-7756-4d87-a1bd-c1a741664842 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Returning 404 to user: Instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 could not be found. {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:28:25.489282 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-c5b9f335-7756-4d87-a1bd-c1a741664842 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 404 len: 111 microversion: 2.1 time: 0.054422 May 13 17:28:25.489282 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 150/300] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:28:25 2022] DELETE /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:28:25.494337 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6e22ac81-7280-4198-9d5c-ad89c3e2cdc3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:25.497917 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6e22ac81-7280-4198-9d5c-ad89c3e2cdc3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] [instance: ebfc247d-ad6b-43f7-adec-b9054fefa3a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:25.500882 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6e22ac81-7280-4198-9d5c-ad89c3e2cdc3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:25.501339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6e22ac81-7280-4198-9d5c-ad89c3e2cdc3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:25.502106 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6e22ac81-7280-4198-9d5c-ad89c3e2cdc3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:25.502549 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6e22ac81-7280-4198-9d5c-ad89c3e2cdc3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:25.515576 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-6e22ac81-7280-4198-9d5c-ad89c3e2cdc3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] HTTP exception thrown: Instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 could not be found. May 13 17:28:25.520604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6e22ac81-7280-4198-9d5c-ad89c3e2cdc3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Request method failure captured: May 13 17:28:25.520604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 HTTP/1.1 May 13 17:28:25.520604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:28:25.520604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:28:25.520604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:28:25.520604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:28:25.520604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:28:25.520604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:28:25.520604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:28:25.520604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:28:25.520604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpTSoB9mNleMeSzUttw1Ib3bXItSauEkTAWYS_K3_ujg5FI3lXO9r0-MBWptjoj07LqVCHbJ8ngm5DYxLo0t0uf3QyDbxnyJFB_dnlnsTi1G0yHzmfoPnqDwXhQCpBYKKCni91qK9vlaWUbxleSyaAzxn6HjLRuEWI3HxU_nj6o0aMc May 13 17:28:25.520604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:28:25.520604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:28:25.520604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:28:25.520604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:28:25.520604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:28:25.520604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:28:25.520604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 7123f57c394d4a35b46f5bf62d48abb7 May 13 17:28:25.520604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-DeleteServersTestJSON-2110234141 May 13 17:28:25.520604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:28:25.520604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:28:25.522051 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/7123f57c394d4a35b46f5bf62d48abb7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7123f57c394d4a35b46f5bf62d48abb7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_7123f57c394d4a35b46f5bf62d48abb7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7123f57c394d4a35b46f5bf62d48abb7"}]}] May 13 17:28:25.522051 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-DeleteServersTestJSON-2110234141 May 13 17:28:25.522051 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 7123f57c394d4a35b46f5bf62d48abb7 May 13 17:28:25.522051 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-DeleteServersTestJSON-2110234141 May 13 17:28:25.522051 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-DeleteServersTestJSON-2110234141-project May 13 17:28:25.522051 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:28:25.522051 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:28:25.522051 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: af2ddeccca5547bfa8ad3804e9041b65 May 13 17:28:25.522051 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-DeleteServersTestJSON-2110234141-project May 13 17:28:25.522051 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: > May 13 17:28:25.522051 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 could not be found. May 13 17:28:25.522051 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'id': 'ebfc247d-ad6b-43f7-adec-b9054fefa3a1'} May 13 17:28:25.522819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:28:25.522819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:28:25.522819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:28:25.522819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:28:25.522819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:28:25.522819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:28:25.522819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:28:25.522819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:28:25.522819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:28:25.522819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:28:25.522819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 could not be found. May 13 17:28:25.522819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:28:25.522819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:28:25.522819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:28:25.522819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:28:25.522819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:28:25.522819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:28:25.522819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:28:25.522819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:28:25.522819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:28:25.524247 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:28:25.524247 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:28:25.524247 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:28:25.524247 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:28:25.524247 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:28:25.524247 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:28:25.524247 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:28:25.524247 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 could not be found. May 13 17:28:25.524247 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:28:25.524247 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:28:25.524247 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:28:25.524247 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:28:25.524247 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:28:25.524247 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:28:25.524247 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:28:25.524247 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:28:25.524247 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 could not be found. May 13 17:28:25.524247 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:28:25.525488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6e22ac81-7280-4198-9d5c-ad89c3e2cdc3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] Returning 404 to user: Instance ebfc247d-ad6b-43f7-adec-b9054fefa3a1 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:28:25.525488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6e22ac81-7280-4198-9d5c-ad89c3e2cdc3 tempest-DeleteServersTestJSON-2110234141 tempest-DeleteServersTestJSON-2110234141-project] 10.222.0.64 "GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1" status: 404 len: 111 microversion: 2.1 time: 0.031522 May 13 17:28:25.525488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 151/301] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:25 2022] GET /compute/v2.1/servers/ebfc247d-ad6b-43f7-adec-b9054fefa3a1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:28:26.263063 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1cdb8052-af3a-4d08-8423-564032b3f79a tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:26.263701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-1cdb8052-af3a-4d08-8423-564032b3f79a tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] [instance: 7dcaff61-29b7-43cb-9660-c12814b944e4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:26.269973 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1cdb8052-af3a-4d08-8423-564032b3f79a tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:26.270426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1cdb8052-af3a-4d08-8423-564032b3f79a tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:26.271225 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1cdb8052-af3a-4d08-8423-564032b3f79a tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:26.271669 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1cdb8052-af3a-4d08-8423-564032b3f79a tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:26.285534 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-1cdb8052-af3a-4d08-8423-564032b3f79a tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] HTTP exception thrown: Instance 7dcaff61-29b7-43cb-9660-c12814b944e4 could not be found. May 13 17:28:26.287043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1cdb8052-af3a-4d08-8423-564032b3f79a tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Request method failure captured: May 13 17:28:26.287043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 HTTP/1.1 May 13 17:28:26.287043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:28:26.287043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:28:26.287043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:28:26.287043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 0 May 13 17:28:26.287043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:28:26.287043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:28:26.287043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:28:26.287043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:28:26.287043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpUTwS5t4rE7uhlQJ0eRYumxB73_6CNo8J-33G5Kat99M5UobEb0INQ5asro-t8Dg2UuXEO6jCGlmUktB8kVyWVGOPS1Fw0jZp71vCDs96qlZOUkwxY6KgADWGfOzp9Ote4p3ApA49DgjpXYJjJmThuoHaYDb7tej4HWw5QuU2J5DKI May 13 17:28:26.287043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:28:26.287043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:28:26.287043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:28:26.287043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:28:26.287043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:28:26.287043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:28:26.287043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: 1e8b971013bf492988f7119cf63c69bc May 13 17:28:26.287043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-VolumesNegativeTest-1450720975 May 13 17:28:26.287043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:28:26.287043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:28:26.288508 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1e8b971013bf492988f7119cf63c69bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e8b971013bf492988f7119cf63c69bc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1e8b971013bf492988f7119cf63c69bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1e8b971013bf492988f7119cf63c69bc"}]}] May 13 17:28:26.288508 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-VolumesNegativeTest-1450720975 May 13 17:28:26.288508 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: 1e8b971013bf492988f7119cf63c69bc May 13 17:28:26.288508 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-VolumesNegativeTest-1450720975 May 13 17:28:26.288508 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-VolumesNegativeTest-1450720975-project May 13 17:28:26.288508 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:28:26.288508 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:28:26.288508 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: 10e55f76eeaa46928289da220ceca447 May 13 17:28:26.288508 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-VolumesNegativeTest-1450720975-project May 13 17:28:26.288508 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: > May 13 17:28:26.288508 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Instance 7dcaff61-29b7-43cb-9660-c12814b944e4 could not be found. May 13 17:28:26.288508 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'id': '7dcaff61-29b7-43cb-9660-c12814b944e4'} May 13 17:28:26.289426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:28:26.289426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:28:26.289426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:28:26.289426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:28:26.289426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:28:26.289426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:28:26.289426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:28:26.289426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:28:26.289426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:28:26.289426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:28:26.289426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dcaff61-29b7-43cb-9660-c12814b944e4 could not be found. May 13 17:28:26.289426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:28:26.289426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:28:26.289426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:28:26.289426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:28:26.289426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:28:26.289426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:28:26.289426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:28:26.289426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:28:26.289426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:28:26.290815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:28:26.290815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:28:26.290815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:28:26.290815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:28:26.290815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:28:26.290815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:28:26.290815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:28:26.290815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dcaff61-29b7-43cb-9660-c12814b944e4 could not be found. May 13 17:28:26.290815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:28:26.290815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:28:26.290815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:28:26.290815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:28:26.290815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:28:26.290815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:28:26.290815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:28:26.290815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:28:26.290815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dcaff61-29b7-43cb-9660-c12814b944e4 could not be found. May 13 17:28:26.290815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:28:26.291894 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1cdb8052-af3a-4d08-8423-564032b3f79a tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] Returning 404 to user: Instance 7dcaff61-29b7-43cb-9660-c12814b944e4 could not be found. {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:28:26.291894 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-1cdb8052-af3a-4d08-8423-564032b3f79a tempest-VolumesNegativeTest-1450720975 tempest-VolumesNegativeTest-1450720975-project] 10.222.0.64 "GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4" status: 404 len: 111 microversion: 2.1 time: 0.029248 May 13 17:28:26.291894 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 151/302] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:26 2022] GET /compute/v2.1/servers/7dcaff61-29b7-43cb-9660-c12814b944e4 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:28:35.777699 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1ee65113-0475-41e1-8979-9e648ad3cd1c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-411895233", "imageRef": "7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:28:35.850211 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.network.neutron [None req-1ee65113-0475-41e1-8979-9e648ad3cd1c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] validate_networks() for [('0ae3692e-0df2-47ad-8286-157d76fd0bbd', None, None, None, None, None)] {{(pid=117493) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 17:28:36.267148 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-1ee65113-0475-41e1-8979-9e648ad3cd1c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Flavor limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 17:28:36.267771 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-1ee65113-0475-41e1-8979-9e648ad3cd1c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Image limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 17:28:36.268327 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-1ee65113-0475-41e1-8979-9e648ad3cd1c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Flavor pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 17:28:36.268912 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-1ee65113-0475-41e1-8979-9e648ad3cd1c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Image pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 17:28:36.269897 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-1ee65113-0475-41e1-8979-9e648ad3cd1c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 17:28:36.279088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1ee65113-0475-41e1-8979-9e648ad3cd1c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:36.279809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1ee65113-0475-41e1-8979-9e648ad3cd1c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:36.280780 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1ee65113-0475-41e1-8979-9e648ad3cd1c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:36.281381 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1ee65113-0475-41e1-8979-9e648ad3cd1c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:36.300046 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-1ee65113-0475-41e1-8979-9e648ad3cd1c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Getting quotas for project 27832590c00f47b7b09c343e892f310a. Resources: {'ram', 'instances', 'cores'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:28:36.304667 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-1ee65113-0475-41e1-8979-9e648ad3cd1c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Getting quotas for user a0294c57ba3f41bc8cf2cac294bb678c and project 27832590c00f47b7b09c343e892f310a. Resources: {'ram', 'instances', 'cores'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:28:36.320731 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1ee65113-0475-41e1-8979-9e648ad3cd1c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Going to run 1 instances... {{(pid=117493) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 17:28:36.320731 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1ee65113-0475-41e1-8979-9e648ad3cd1c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 17:28:36.428324 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1ee65113-0475-41e1-8979-9e648ad3cd1c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.899174 May 13 17:28:36.433821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 152/303] 10.222.0.64 () {60 vars in 1146 bytes} [Fri May 13 17:28:35 2022] POST /compute/v2.1/servers => generated 383 bytes in 903 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 17:28:36.439581 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-4bece8df-fdd4-450b-85a2-8f8de422537e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:36.440761 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-4bece8df-fdd4-450b-85a2-8f8de422537e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:36.553804 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-4bece8df-fdd4-450b-85a2-8f8de422537e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:36.577001 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-4bece8df-fdd4-450b-85a2-8f8de422537e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1221 microversion: 2.1 time: 0.141145 May 13 17:28:36.578237 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 152/304] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:36 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1221 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:36.698508 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ecbbbb66-0205-4333-9d86-997827bb4d23 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1319341911", "imageRef": "7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:28:36.765376 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.network.neutron [None req-ecbbbb66-0205-4333-9d86-997827bb4d23 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] validate_networks() for [('0ae3692e-0df2-47ad-8286-157d76fd0bbd', None, None, None, None, None)] {{(pid=117493) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 17:28:37.257156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-ecbbbb66-0205-4333-9d86-997827bb4d23 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Flavor limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 17:28:37.257926 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-ecbbbb66-0205-4333-9d86-997827bb4d23 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Image limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 17:28:37.258406 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-ecbbbb66-0205-4333-9d86-997827bb4d23 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Flavor pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 17:28:37.258920 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-ecbbbb66-0205-4333-9d86-997827bb4d23 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Image pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 17:28:37.259657 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-ecbbbb66-0205-4333-9d86-997827bb4d23 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 17:28:37.271427 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ecbbbb66-0205-4333-9d86-997827bb4d23 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:37.271427 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ecbbbb66-0205-4333-9d86-997827bb4d23 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:37.271967 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ecbbbb66-0205-4333-9d86-997827bb4d23 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:37.272554 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ecbbbb66-0205-4333-9d86-997827bb4d23 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:37.299332 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-ecbbbb66-0205-4333-9d86-997827bb4d23 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Getting quotas for project 27832590c00f47b7b09c343e892f310a. Resources: {'ram', 'instances', 'cores'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:28:37.300014 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-ecbbbb66-0205-4333-9d86-997827bb4d23 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Getting quotas for user a0294c57ba3f41bc8cf2cac294bb678c and project 27832590c00f47b7b09c343e892f310a. Resources: {'ram', 'instances', 'cores'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:28:37.318945 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ecbbbb66-0205-4333-9d86-997827bb4d23 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Going to run 1 instances... {{(pid=117493) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 17:28:37.322026 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ecbbbb66-0205-4333-9d86-997827bb4d23 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 17:28:37.365202 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-2693598f-4409-4c58-ac40-ce14c273e35d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1714476661", "imageRef": "7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88", "flavorRef": "452", "networks": [{"uuid": "0a5f1f56-1292-4f48-b919-1c7423ffdedd"}]}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:28:37.485904 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.network.neutron [None req-2693598f-4409-4c58-ac40-ce14c273e35d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] validate_networks() for [('0a5f1f56-1292-4f48-b919-1c7423ffdedd', None, None, None, None, None)] {{(pid=117492) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 17:28:37.501840 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ecbbbb66-0205-4333-9d86-997827bb4d23 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.808437 May 13 17:28:37.503289 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 153/305] 10.222.0.64 () {60 vars in 1146 bytes} [Fri May 13 17:28:36 2022] POST /compute/v2.1/servers => generated 383 bytes in 810 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 17:28:37.515278 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f450f47a-d295-4122-acd0-d5cf28cc0b3e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:37.516083 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f450f47a-d295-4122-acd0-d5cf28cc0b3e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:37.672490 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f450f47a-d295-4122-acd0-d5cf28cc0b3e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:37.686914 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f450f47a-d295-4122-acd0-d5cf28cc0b3e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1222 microversion: 2.1 time: 0.175274 May 13 17:28:37.690712 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 154/306] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:37 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1222 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:38.093272 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-2693598f-4409-4c58-ac40-ce14c273e35d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Flavor limits 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 17:28:38.093776 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-2693598f-4409-4c58-ac40-ce14c273e35d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Image limits 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 17:28:38.094516 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-2693598f-4409-4c58-ac40-ce14c273e35d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Flavor pref 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 17:28:38.094951 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-2693598f-4409-4c58-ac40-ce14c273e35d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Image pref 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 17:28:38.097851 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-2693598f-4409-4c58-ac40-ce14c273e35d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 17:28:38.104330 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2693598f-4409-4c58-ac40-ce14c273e35d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:38.104781 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2693598f-4409-4c58-ac40-ce14c273e35d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:38.105585 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2693598f-4409-4c58-ac40-ce14c273e35d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:38.106025 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2693598f-4409-4c58-ac40-ce14c273e35d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:38.123519 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-2693598f-4409-4c58-ac40-ce14c273e35d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Getting quotas for project f6fceef0782240ccb486341a9007e4b0. Resources: {'ram', 'instances', 'cores'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:28:38.127530 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-2693598f-4409-4c58-ac40-ce14c273e35d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Getting quotas for user e7d764501bed41d99941c6e083e19482 and project f6fceef0782240ccb486341a9007e4b0. Resources: {'ram', 'instances', 'cores'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:28:38.139231 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-2693598f-4409-4c58-ac40-ce14c273e35d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Going to run 1 instances... {{(pid=117492) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 17:28:38.141543 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-2693598f-4409-4c58-ac40-ce14c273e35d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 17:28:38.265995 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-2693598f-4409-4c58-ac40-ce14c273e35d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.906476 May 13 17:28:38.288658 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-24001110-f48e-42a2-8f15-e4901b6e2d03 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:38.289802 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-24001110-f48e-42a2-8f15-e4901b6e2d03 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:38.294911 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 153/307] 10.222.0.64 () {60 vars in 1146 bytes} [Fri May 13 17:28:37 2022] POST /compute/v2.1/servers => generated 380 bytes in 936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 17:28:38.399097 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-24001110-f48e-42a2-8f15-e4901b6e2d03 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:38.407092 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-24001110-f48e-42a2-8f15-e4901b6e2d03 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1214 microversion: 2.1 time: 0.129512 May 13 17:28:38.408552 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 155/308] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:38 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1214 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:38.717158 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-97168395-88a3-4777-90fb-cdcf5c0a4091 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:38.725304 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-97168395-88a3-4777-90fb-cdcf5c0a4091 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:38.750788 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-97168395-88a3-4777-90fb-cdcf5c0a4091 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:38.755342 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-97168395-88a3-4777-90fb-cdcf5c0a4091 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:38.755342 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-97168395-88a3-4777-90fb-cdcf5c0a4091 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:38.755342 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-97168395-88a3-4777-90fb-cdcf5c0a4091 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:39.189142 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-97168395-88a3-4777-90fb-cdcf5c0a4091 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:39.197737 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-97168395-88a3-4777-90fb-cdcf5c0a4091 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1226 microversion: 2.1 time: 0.489360 May 13 17:28:39.207829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 154/309] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:38 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1226 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:39.427178 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-de4cbd43-2149-42d4-8bd5-4846bf6292d4 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:39.428114 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-de4cbd43-2149-42d4-8bd5-4846bf6292d4 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:39.524520 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-de4cbd43-2149-42d4-8bd5-4846bf6292d4 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:39.535364 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-de4cbd43-2149-42d4-8bd5-4846bf6292d4 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1214 microversion: 2.1 time: 0.113740 May 13 17:28:39.535940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 156/310] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:39 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1214 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:40.215314 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-49349c43-d769-4e10-b385-1c86056bc961 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:40.215929 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-49349c43-d769-4e10-b385-1c86056bc961 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:40.223394 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-49349c43-d769-4e10-b385-1c86056bc961 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:40.224106 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-49349c43-d769-4e10-b385-1c86056bc961 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:40.229740 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-49349c43-d769-4e10-b385-1c86056bc961 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:40.229740 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-49349c43-d769-4e10-b385-1c86056bc961 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:40.302735 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-49349c43-d769-4e10-b385-1c86056bc961 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:40.315235 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-49349c43-d769-4e10-b385-1c86056bc961 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1218 microversion: 2.1 time: 0.103834 May 13 17:28:40.325143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 155/311] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:40 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1218 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:40.552139 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-160d1f0f-861b-4b25-9941-7ba1c7e4a2aa tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:40.553028 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-160d1f0f-861b-4b25-9941-7ba1c7e4a2aa tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:40.559186 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-160d1f0f-861b-4b25-9941-7ba1c7e4a2aa tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:40.559646 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-160d1f0f-861b-4b25-9941-7ba1c7e4a2aa tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:40.560435 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-160d1f0f-861b-4b25-9941-7ba1c7e4a2aa tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:40.560866 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-160d1f0f-861b-4b25-9941-7ba1c7e4a2aa tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:40.625505 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-160d1f0f-861b-4b25-9941-7ba1c7e4a2aa tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:40.633560 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-160d1f0f-861b-4b25-9941-7ba1c7e4a2aa tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1210 microversion: 2.1 time: 0.085233 May 13 17:28:40.634789 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 157/312] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:40 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:41.334691 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7324e2b9-a210-4c04-ae5f-cdf4e38f92f1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:41.335350 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7324e2b9-a210-4c04-ae5f-cdf4e38f92f1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:41.341064 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7324e2b9-a210-4c04-ae5f-cdf4e38f92f1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:41.341517 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7324e2b9-a210-4c04-ae5f-cdf4e38f92f1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:41.342286 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7324e2b9-a210-4c04-ae5f-cdf4e38f92f1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:41.342725 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7324e2b9-a210-4c04-ae5f-cdf4e38f92f1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:41.408547 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7324e2b9-a210-4c04-ae5f-cdf4e38f92f1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:41.416673 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7324e2b9-a210-4c04-ae5f-cdf4e38f92f1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1218 microversion: 2.1 time: 0.086221 May 13 17:28:41.417260 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 156/313] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:41 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:41.650525 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d7456041-0019-4c01-8c63-b05d0dbae22a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:41.651448 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d7456041-0019-4c01-8c63-b05d0dbae22a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:41.657624 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d7456041-0019-4c01-8c63-b05d0dbae22a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:41.658158 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d7456041-0019-4c01-8c63-b05d0dbae22a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:41.659015 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d7456041-0019-4c01-8c63-b05d0dbae22a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:41.660210 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d7456041-0019-4c01-8c63-b05d0dbae22a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:41.726023 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d7456041-0019-4c01-8c63-b05d0dbae22a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:41.733832 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d7456041-0019-4c01-8c63-b05d0dbae22a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1210 microversion: 2.1 time: 0.087045 May 13 17:28:41.734425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 158/314] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:41 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1210 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:42.434000 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d31a2ae1-8c3d-49d6-af2c-c86302e5231d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:42.434759 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d31a2ae1-8c3d-49d6-af2c-c86302e5231d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:42.442367 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d31a2ae1-8c3d-49d6-af2c-c86302e5231d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:42.443345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d31a2ae1-8c3d-49d6-af2c-c86302e5231d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:42.444859 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d31a2ae1-8c3d-49d6-af2c-c86302e5231d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:42.446257 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d31a2ae1-8c3d-49d6-af2c-c86302e5231d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:42.557390 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d31a2ae1-8c3d-49d6-af2c-c86302e5231d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:42.565066 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d31a2ae1-8c3d-49d6-af2c-c86302e5231d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1218 microversion: 2.1 time: 0.135038 May 13 17:28:42.566753 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 157/315] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:42 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1218 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:42.751493 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-addaf647-b250-4636-990b-fae792f1dab6 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:42.752691 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-addaf647-b250-4636-990b-fae792f1dab6 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:42.761450 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-addaf647-b250-4636-990b-fae792f1dab6 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:42.761995 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-addaf647-b250-4636-990b-fae792f1dab6 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:42.763016 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-addaf647-b250-4636-990b-fae792f1dab6 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:42.763701 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-addaf647-b250-4636-990b-fae792f1dab6 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:42.837468 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-addaf647-b250-4636-990b-fae792f1dab6 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:42.844895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-addaf647-b250-4636-990b-fae792f1dab6 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1210 microversion: 2.1 time: 0.097228 May 13 17:28:42.854501 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 159/316] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:42 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:43.582544 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-60e23653-233d-4d80-b297-b33d13396b6a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:43.583253 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-60e23653-233d-4d80-b297-b33d13396b6a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:43.589846 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-60e23653-233d-4d80-b297-b33d13396b6a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:43.590322 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-60e23653-233d-4d80-b297-b33d13396b6a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:43.591381 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-60e23653-233d-4d80-b297-b33d13396b6a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:43.591896 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-60e23653-233d-4d80-b297-b33d13396b6a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:43.699526 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-60e23653-233d-4d80-b297-b33d13396b6a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:43.710534 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-60e23653-233d-4d80-b297-b33d13396b6a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1218 microversion: 2.1 time: 0.132384 May 13 17:28:43.711158 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 158/317] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:43 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1218 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:43.862115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-19b57418-78d3-494e-8ab8-650fdbe0fd96 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:43.862729 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-19b57418-78d3-494e-8ab8-650fdbe0fd96 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:43.869289 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-19b57418-78d3-494e-8ab8-650fdbe0fd96 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:43.869741 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-19b57418-78d3-494e-8ab8-650fdbe0fd96 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:43.870525 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-19b57418-78d3-494e-8ab8-650fdbe0fd96 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:43.870961 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-19b57418-78d3-494e-8ab8-650fdbe0fd96 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:44.100185 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-19b57418-78d3-494e-8ab8-650fdbe0fd96 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:44.107457 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-19b57418-78d3-494e-8ab8-650fdbe0fd96 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1210 microversion: 2.1 time: 0.249283 May 13 17:28:44.108211 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 160/318] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:43 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1210 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:44.733036 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-489e9a59-c77f-4ed2-a739-5107eb631e13 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:44.733036 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-489e9a59-c77f-4ed2-a739-5107eb631e13 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:44.736803 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-489e9a59-c77f-4ed2-a739-5107eb631e13 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:44.739708 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-489e9a59-c77f-4ed2-a739-5107eb631e13 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:44.742252 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-489e9a59-c77f-4ed2-a739-5107eb631e13 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:44.742812 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-489e9a59-c77f-4ed2-a739-5107eb631e13 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:44.914930 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-ec8e5792-0602-4619-8383-ae5c16f9f310 req-6ac73cf1-c30a-46a8-8431-d0d1bd68cd4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ee92d4ec-0b6a-4fae-8b6c-eaf330781f58", "tag": "8c1697c5-1f14-4626-9fa8-129fec582059"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:28:44.930172 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-ec8e5792-0602-4619-8383-ae5c16f9f310 req-6ac73cf1-c30a-46a8-8431-d0d1bd68cd4f service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:44.936219 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-ec8e5792-0602-4619-8383-ae5c16f9f310 req-6ac73cf1-c30a-46a8-8431-d0d1bd68cd4f service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:44.949117 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-ec8e5792-0602-4619-8383-ae5c16f9f310 req-6ac73cf1-c30a-46a8-8431-d0d1bd68cd4f service nova] Creating event network-changed:8c1697c5-1f14-4626-9fa8-129fec582059 for instance ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 on hv-cinder-84178 May 13 17:28:44.955601 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-ec8e5792-0602-4619-8383-ae5c16f9f310 req-6ac73cf1-c30a-46a8-8431-d0d1bd68cd4f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044432 May 13 17:28:44.957280 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 161/319] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:28:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:28:44.964541 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-489e9a59-c77f-4ed2-a739-5107eb631e13 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:44.974612 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-489e9a59-c77f-4ed2-a739-5107eb631e13 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1218 microversion: 2.1 time: 0.249990 May 13 17:28:44.975768 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 159/320] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:44 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1218 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:45.125844 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-915a1495-b9cd-4e73-9a72-b35f6e61c076 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:45.126493 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-915a1495-b9cd-4e73-9a72-b35f6e61c076 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:45.132911 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-915a1495-b9cd-4e73-9a72-b35f6e61c076 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:45.133368 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-915a1495-b9cd-4e73-9a72-b35f6e61c076 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:45.134152 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-915a1495-b9cd-4e73-9a72-b35f6e61c076 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:45.134587 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-915a1495-b9cd-4e73-9a72-b35f6e61c076 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:45.225751 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-915a1495-b9cd-4e73-9a72-b35f6e61c076 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:45.233447 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-915a1495-b9cd-4e73-9a72-b35f6e61c076 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1284 microversion: 2.1 time: 0.111983 May 13 17:28:45.234004 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 162/321] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:45 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1284 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:45.993695 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-ebb2c601-132a-4f75-87e8-d7465f64802c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:45.994981 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-ebb2c601-132a-4f75-87e8-d7465f64802c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:46.007809 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ebb2c601-132a-4f75-87e8-d7465f64802c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:46.009265 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ebb2c601-132a-4f75-87e8-d7465f64802c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:46.011420 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ebb2c601-132a-4f75-87e8-d7465f64802c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:46.014203 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ebb2c601-132a-4f75-87e8-d7465f64802c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:46.148972 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-ebb2c601-132a-4f75-87e8-d7465f64802c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:46.158549 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-ebb2c601-132a-4f75-87e8-d7465f64802c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1282 microversion: 2.1 time: 0.169945 May 13 17:28:46.187969 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 160/322] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:45 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1282 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:46.250372 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ce39915a-8268-4b85-a9b8-575df149dd02 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:46.252235 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ce39915a-8268-4b85-a9b8-575df149dd02 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:46.260772 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ce39915a-8268-4b85-a9b8-575df149dd02 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:46.262455 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ce39915a-8268-4b85-a9b8-575df149dd02 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:46.264205 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ce39915a-8268-4b85-a9b8-575df149dd02 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:46.264902 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ce39915a-8268-4b85-a9b8-575df149dd02 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:46.413894 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ce39915a-8268-4b85-a9b8-575df149dd02 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:46.422559 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ce39915a-8268-4b85-a9b8-575df149dd02 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1272 microversion: 2.1 time: 0.176429 May 13 17:28:46.434266 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 163/323] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:46 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1272 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:47.180927 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-833c6270-81cc-440c-9d46-3df19bd54dec tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:47.182247 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-833c6270-81cc-440c-9d46-3df19bd54dec tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:47.190890 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-833c6270-81cc-440c-9d46-3df19bd54dec tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:47.193900 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-833c6270-81cc-440c-9d46-3df19bd54dec tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:47.197601 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-833c6270-81cc-440c-9d46-3df19bd54dec tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:47.198298 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-833c6270-81cc-440c-9d46-3df19bd54dec tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:47.442858 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-aecb700e-a393-44c2-b649-3c1e1b04c866 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:47.444526 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-aecb700e-a393-44c2-b649-3c1e1b04c866 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:47.470378 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aecb700e-a393-44c2-b649-3c1e1b04c866 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:47.470378 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aecb700e-a393-44c2-b649-3c1e1b04c866 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:47.470378 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aecb700e-a393-44c2-b649-3c1e1b04c866 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:47.470378 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aecb700e-a393-44c2-b649-3c1e1b04c866 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:47.791704 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-833c6270-81cc-440c-9d46-3df19bd54dec tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:47.794843 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-aecb700e-a393-44c2-b649-3c1e1b04c866 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:47.801172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-833c6270-81cc-440c-9d46-3df19bd54dec tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1322 microversion: 2.1 time: 0.625039 May 13 17:28:47.802715 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 161/324] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:47 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1322 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:47.813041 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-aecb700e-a393-44c2-b649-3c1e1b04c866 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1314 microversion: 2.1 time: 0.365738 May 13 17:28:47.822675 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 164/325] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:47 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1314 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:48.832414 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ba75af51-780c-4f38-94b2-0495ce886c87 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:48.832414 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ba75af51-780c-4f38-94b2-0495ce886c87 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:48.833559 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b96c2a85-ff80-49bb-a094-d5ae31e9c811 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:48.834845 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b96c2a85-ff80-49bb-a094-d5ae31e9c811 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:48.839550 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ba75af51-780c-4f38-94b2-0495ce886c87 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:48.840752 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ba75af51-780c-4f38-94b2-0495ce886c87 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:48.848075 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ba75af51-780c-4f38-94b2-0495ce886c87 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:48.848646 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ba75af51-780c-4f38-94b2-0495ce886c87 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:48.863676 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b96c2a85-ff80-49bb-a094-d5ae31e9c811 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:48.866270 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b96c2a85-ff80-49bb-a094-d5ae31e9c811 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:48.866270 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b96c2a85-ff80-49bb-a094-d5ae31e9c811 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:48.866270 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b96c2a85-ff80-49bb-a094-d5ae31e9c811 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:49.056827 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ba75af51-780c-4f38-94b2-0495ce886c87 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:49.068190 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ba75af51-780c-4f38-94b2-0495ce886c87 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1314 microversion: 2.1 time: 0.241203 May 13 17:28:49.071915 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 165/326] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:48 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:49.208244 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b96c2a85-ff80-49bb-a094-d5ae31e9c811 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:49.224001 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b96c2a85-ff80-49bb-a094-d5ae31e9c811 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1322 microversion: 2.1 time: 0.400792 May 13 17:28:49.224662 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 162/327] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:48 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1322 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:50.088173 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a1d394f0-2715-47ea-a417-dc5a96130d0b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:50.088173 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a1d394f0-2715-47ea-a417-dc5a96130d0b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:50.101551 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a1d394f0-2715-47ea-a417-dc5a96130d0b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:50.103380 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a1d394f0-2715-47ea-a417-dc5a96130d0b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:50.103380 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a1d394f0-2715-47ea-a417-dc5a96130d0b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:50.103380 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a1d394f0-2715-47ea-a417-dc5a96130d0b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:50.241041 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b4df055a-e8a8-4430-bdc2-c9236ae48a5a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:50.241780 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b4df055a-e8a8-4430-bdc2-c9236ae48a5a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:50.255293 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b4df055a-e8a8-4430-bdc2-c9236ae48a5a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:50.255753 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b4df055a-e8a8-4430-bdc2-c9236ae48a5a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:50.256559 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b4df055a-e8a8-4430-bdc2-c9236ae48a5a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:50.257002 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b4df055a-e8a8-4430-bdc2-c9236ae48a5a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:50.880287 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b4df055a-e8a8-4430-bdc2-c9236ae48a5a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:50.893248 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b4df055a-e8a8-4430-bdc2-c9236ae48a5a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1322 microversion: 2.1 time: 0.654612 May 13 17:28:50.896409 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 163/328] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:50 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1322 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:50.942659 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a1d394f0-2715-47ea-a417-dc5a96130d0b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:50.952017 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a1d394f0-2715-47ea-a417-dc5a96130d0b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1314 microversion: 2.1 time: 0.870217 May 13 17:28:50.964343 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 166/329] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:50 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1314 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:51.919175 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-e56cad3b-c1d3-4b8e-8502-38fcc87519d1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:51.919862 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-e56cad3b-c1d3-4b8e-8502-38fcc87519d1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:51.947840 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e56cad3b-c1d3-4b8e-8502-38fcc87519d1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:51.948303 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e56cad3b-c1d3-4b8e-8502-38fcc87519d1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:51.950702 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e56cad3b-c1d3-4b8e-8502-38fcc87519d1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:51.954463 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e56cad3b-c1d3-4b8e-8502-38fcc87519d1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:51.971355 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4d36f802-3185-472e-ae16-66c2c6230f56 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:51.972085 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4d36f802-3185-472e-ae16-66c2c6230f56 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:51.980979 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d36f802-3185-472e-ae16-66c2c6230f56 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:51.981938 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d36f802-3185-472e-ae16-66c2c6230f56 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:51.982883 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d36f802-3185-472e-ae16-66c2c6230f56 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:51.988551 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d36f802-3185-472e-ae16-66c2c6230f56 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:52.332155 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-e56cad3b-c1d3-4b8e-8502-38fcc87519d1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:52.349576 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-e56cad3b-c1d3-4b8e-8502-38fcc87519d1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1322 microversion: 2.1 time: 0.433652 May 13 17:28:52.350245 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 164/330] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:51 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1322 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:52.363625 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-f3f7b45e-b383-471a-8044-1ee0d5dad13d req-12513230-9c5e-4799-808c-4f99714e0045 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9d3d26f-4dd5-4068-bee2-60b3d1a71055", "tag": "c3ddca4e-2887-4fd8-919d-7abc574f54f5"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:28:52.378645 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-f3f7b45e-b383-471a-8044-1ee0d5dad13d req-12513230-9c5e-4799-808c-4f99714e0045 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:52.379418 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-f3f7b45e-b383-471a-8044-1ee0d5dad13d req-12513230-9c5e-4799-808c-4f99714e0045 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:52.403971 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-f3f7b45e-b383-471a-8044-1ee0d5dad13d req-12513230-9c5e-4799-808c-4f99714e0045 service nova] Creating event network-changed:c3ddca4e-2887-4fd8-919d-7abc574f54f5 for instance f9d3d26f-4dd5-4068-bee2-60b3d1a71055 on hv-cinder-84178 May 13 17:28:52.425850 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-f3f7b45e-b383-471a-8044-1ee0d5dad13d req-12513230-9c5e-4799-808c-4f99714e0045 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062670 May 13 17:28:52.425850 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 165/331] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:28:52.618276 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4d36f802-3185-472e-ae16-66c2c6230f56 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:52.625378 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4d36f802-3185-472e-ae16-66c2c6230f56 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1314 microversion: 2.1 time: 0.658251 May 13 17:28:52.639224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 167/332] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:51 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1314 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:28:52.780922 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-910583ed-c4b5-4a14-ac46-ca41bc9058c4 req-568eb959-6159-41eb-9208-99c93c7f8c00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee92d4ec-0b6a-4fae-8b6c-eaf330781f58", "name": "network-vif-plugged", "status": "completed", "tag": "8c1697c5-1f14-4626-9fa8-129fec582059"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:28:52.797194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-910583ed-c4b5-4a14-ac46-ca41bc9058c4 req-568eb959-6159-41eb-9208-99c93c7f8c00 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:52.797640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-910583ed-c4b5-4a14-ac46-ca41bc9058c4 req-568eb959-6159-41eb-9208-99c93c7f8c00 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:52.824244 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-910583ed-c4b5-4a14-ac46-ca41bc9058c4 req-568eb959-6159-41eb-9208-99c93c7f8c00 service nova] Creating event network-vif-plugged:8c1697c5-1f14-4626-9fa8-129fec582059 for instance ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 on hv-cinder-84178 May 13 17:28:52.845371 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-910583ed-c4b5-4a14-ac46-ca41bc9058c4 req-568eb959-6159-41eb-9208-99c93c7f8c00 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068823 May 13 17:28:52.866986 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 166/333] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:28:53.374692 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5f93a654-1858-41f8-ae03-ee95c45d26a6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:53.376841 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5f93a654-1858-41f8-ae03-ee95c45d26a6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:53.394500 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5f93a654-1858-41f8-ae03-ee95c45d26a6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:53.397445 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5f93a654-1858-41f8-ae03-ee95c45d26a6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:53.400754 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5f93a654-1858-41f8-ae03-ee95c45d26a6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:53.401380 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5f93a654-1858-41f8-ae03-ee95c45d26a6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:53.645441 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-76097ad0-f3f9-4544-8fba-364645187096 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:53.647950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-76097ad0-f3f9-4544-8fba-364645187096 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:53.669197 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-76097ad0-f3f9-4544-8fba-364645187096 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:53.675799 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-76097ad0-f3f9-4544-8fba-364645187096 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:53.675799 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-76097ad0-f3f9-4544-8fba-364645187096 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:53.680568 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-76097ad0-f3f9-4544-8fba-364645187096 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:53.876783 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5f93a654-1858-41f8-ae03-ee95c45d26a6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:53.889489 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5f93a654-1858-41f8-ae03-ee95c45d26a6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1322 microversion: 2.1 time: 0.527219 May 13 17:28:53.891437 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 168/334] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:53 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1322 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:53.941948 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-76097ad0-f3f9-4544-8fba-364645187096 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:53.945182 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-76097ad0-f3f9-4544-8fba-364645187096 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1314 microversion: 2.1 time: 0.306159 May 13 17:28:53.949315 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 167/335] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:53 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:54.451918 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-0eebce48-3028-45ba-b857-73ffcb446753 req-73f7e367-d570-432a-8f8d-8f798bf74a79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc", "tag": "fb94ca7c-01fc-441c-a41a-2b1ad50471cb"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:28:54.462199 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-0eebce48-3028-45ba-b857-73ffcb446753 req-73f7e367-d570-432a-8f8d-8f798bf74a79 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:54.463844 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-0eebce48-3028-45ba-b857-73ffcb446753 req-73f7e367-d570-432a-8f8d-8f798bf74a79 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:54.478073 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-0eebce48-3028-45ba-b857-73ffcb446753 req-73f7e367-d570-432a-8f8d-8f798bf74a79 service nova] Creating event network-changed:fb94ca7c-01fc-441c-a41a-2b1ad50471cb for instance bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc on hv-cinder-84178 May 13 17:28:54.483735 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-0eebce48-3028-45ba-b857-73ffcb446753 req-73f7e367-d570-432a-8f8d-8f798bf74a79 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035736 May 13 17:28:54.484404 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 169/336] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:28:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:28:54.906312 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-87cc57a4-35ee-4e62-b1bb-fb7c3bf19814 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:54.906912 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-87cc57a4-35ee-4e62-b1bb-fb7c3bf19814 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:54.913266 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-87cc57a4-35ee-4e62-b1bb-fb7c3bf19814 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:54.913713 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-87cc57a4-35ee-4e62-b1bb-fb7c3bf19814 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:54.914931 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-87cc57a4-35ee-4e62-b1bb-fb7c3bf19814 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:54.915419 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-87cc57a4-35ee-4e62-b1bb-fb7c3bf19814 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:54.965751 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-22f30d04-25ea-481b-b1a3-0a7d4c42edd2 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:54.966527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-22f30d04-25ea-481b-b1a3-0a7d4c42edd2 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:54.975334 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-22f30d04-25ea-481b-b1a3-0a7d4c42edd2 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:54.977234 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-22f30d04-25ea-481b-b1a3-0a7d4c42edd2 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:54.977234 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-22f30d04-25ea-481b-b1a3-0a7d4c42edd2 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:54.977234 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-22f30d04-25ea-481b-b1a3-0a7d4c42edd2 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:55.142549 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-87cc57a4-35ee-4e62-b1bb-fb7c3bf19814 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:55.152622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-87cc57a4-35ee-4e62-b1bb-fb7c3bf19814 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1322 microversion: 2.1 time: 0.250045 May 13 17:28:55.153756 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 168/337] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:54 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1322 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:55.586986 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-22f30d04-25ea-481b-b1a3-0a7d4c42edd2 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:55.598511 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-22f30d04-25ea-481b-b1a3-0a7d4c42edd2 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1314 microversion: 2.1 time: 0.635168 May 13 17:28:55.611351 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 170/338] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:54 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1314 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:56.170740 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-2b5663e3-8b97-4071-8949-765c98e802cb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:56.172160 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-2b5663e3-8b97-4071-8949-765c98e802cb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:56.180528 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2b5663e3-8b97-4071-8949-765c98e802cb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:56.182514 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2b5663e3-8b97-4071-8949-765c98e802cb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:56.184217 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2b5663e3-8b97-4071-8949-765c98e802cb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:56.185393 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2b5663e3-8b97-4071-8949-765c98e802cb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:56.495495 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-2b5663e3-8b97-4071-8949-765c98e802cb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:56.507486 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-2b5663e3-8b97-4071-8949-765c98e802cb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1322 microversion: 2.1 time: 0.341421 May 13 17:28:56.512899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 169/339] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:56 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1322 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:56.618798 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3b405ff7-53b8-4562-890d-d34735629513 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:56.618798 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3b405ff7-53b8-4562-890d-d34735629513 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:56.628203 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3b405ff7-53b8-4562-890d-d34735629513 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:56.630697 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3b405ff7-53b8-4562-890d-d34735629513 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:56.631596 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3b405ff7-53b8-4562-890d-d34735629513 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:56.632049 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3b405ff7-53b8-4562-890d-d34735629513 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:56.938122 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3b405ff7-53b8-4562-890d-d34735629513 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:56.946302 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3b405ff7-53b8-4562-890d-d34735629513 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1314 microversion: 2.1 time: 0.334327 May 13 17:28:56.947290 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 171/340] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:56 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1314 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:57.535959 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-0a1051d5-5d04-4603-853f-2551b6b5cbb6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:57.536739 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-0a1051d5-5d04-4603-853f-2551b6b5cbb6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:57.546933 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0a1051d5-5d04-4603-853f-2551b6b5cbb6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:57.549066 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0a1051d5-5d04-4603-853f-2551b6b5cbb6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:57.552737 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0a1051d5-5d04-4603-853f-2551b6b5cbb6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:57.553767 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0a1051d5-5d04-4603-853f-2551b6b5cbb6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:57.853669 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0a1051d5-5d04-4603-853f-2551b6b5cbb6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:57.865394 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-0a1051d5-5d04-4603-853f-2551b6b5cbb6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1322 microversion: 2.1 time: 0.335162 May 13 17:28:57.866554 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 170/341] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:57 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1322 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:57.963538 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-88dff140-f8fd-4eae-8921-fd74613342cc tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:57.964778 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-88dff140-f8fd-4eae-8921-fd74613342cc tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:57.979749 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-88dff140-f8fd-4eae-8921-fd74613342cc tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:57.979749 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-88dff140-f8fd-4eae-8921-fd74613342cc tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:57.979749 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-88dff140-f8fd-4eae-8921-fd74613342cc tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:57.979749 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-88dff140-f8fd-4eae-8921-fd74613342cc tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:58.392977 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-88dff140-f8fd-4eae-8921-fd74613342cc tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:58.406165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-88dff140-f8fd-4eae-8921-fd74613342cc tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1314 microversion: 2.1 time: 0.442761 May 13 17:28:58.408103 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 172/342] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:57 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1314 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:28:58.882457 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-cf7858e8-edda-4e8c-a573-9f3379e8d95a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:58.883258 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-cf7858e8-edda-4e8c-a573-9f3379e8d95a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:58.895361 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cf7858e8-edda-4e8c-a573-9f3379e8d95a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:58.895807 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cf7858e8-edda-4e8c-a573-9f3379e8d95a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:58.896602 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cf7858e8-edda-4e8c-a573-9f3379e8d95a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:58.897034 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cf7858e8-edda-4e8c-a573-9f3379e8d95a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:59.178043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-cf7858e8-edda-4e8c-a573-9f3379e8d95a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:59.186509 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-cf7858e8-edda-4e8c-a573-9f3379e8d95a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1322 microversion: 2.1 time: 0.308525 May 13 17:28:59.192660 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 171/343] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:58 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1322 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:28:59.424401 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-62fc55ad-e6fa-4488-945b-022b3f90e869 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:28:59.426311 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-62fc55ad-e6fa-4488-945b-022b3f90e869 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:28:59.438516 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-62fc55ad-e6fa-4488-945b-022b3f90e869 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:59.439084 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-62fc55ad-e6fa-4488-945b-022b3f90e869 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:59.442071 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-62fc55ad-e6fa-4488-945b-022b3f90e869 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:28:59.444366 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-62fc55ad-e6fa-4488-945b-022b3f90e869 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:28:59.803031 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-62fc55ad-e6fa-4488-945b-022b3f90e869 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:28:59.821918 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-62fc55ad-e6fa-4488-945b-022b3f90e869 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1314 microversion: 2.1 time: 0.400807 May 13 17:28:59.832116 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 173/344] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:28:59 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1314 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:00.208804 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-ae0d2ea1-aef3-4409-8779-44bf66ca2c80 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:00.210057 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-ae0d2ea1-aef3-4409-8779-44bf66ca2c80 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:00.222914 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ae0d2ea1-aef3-4409-8779-44bf66ca2c80 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:00.227622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ae0d2ea1-aef3-4409-8779-44bf66ca2c80 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:00.232159 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ae0d2ea1-aef3-4409-8779-44bf66ca2c80 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:00.234979 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ae0d2ea1-aef3-4409-8779-44bf66ca2c80 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:00.613929 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-ae0d2ea1-aef3-4409-8779-44bf66ca2c80 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:00.632926 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-ae0d2ea1-aef3-4409-8779-44bf66ca2c80 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1322 microversion: 2.1 time: 0.429370 May 13 17:29:00.633530 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 172/345] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:00 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1322 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:00.849967 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b383982e-beaf-4091-a947-ad1e4bfcfe65 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:00.850780 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b383982e-beaf-4091-a947-ad1e4bfcfe65 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:00.880120 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b383982e-beaf-4091-a947-ad1e4bfcfe65 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:00.886631 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b383982e-beaf-4091-a947-ad1e4bfcfe65 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:00.889749 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b383982e-beaf-4091-a947-ad1e4bfcfe65 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:00.893431 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b383982e-beaf-4091-a947-ad1e4bfcfe65 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:01.454647 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-0d27a712-1b30-46e3-994b-17fc5724792d req-99da5ee5-238d-4934-865c-0e97af4ec41d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9d3d26f-4dd5-4068-bee2-60b3d1a71055", "name": "network-vif-plugged", "status": "completed", "tag": "c3ddca4e-2887-4fd8-919d-7abc574f54f5"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:29:01.470369 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-0d27a712-1b30-46e3-994b-17fc5724792d req-99da5ee5-238d-4934-865c-0e97af4ec41d service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:01.470815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-0d27a712-1b30-46e3-994b-17fc5724792d req-99da5ee5-238d-4934-865c-0e97af4ec41d service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:01.488745 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b383982e-beaf-4091-a947-ad1e4bfcfe65 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:01.494392 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-0d27a712-1b30-46e3-994b-17fc5724792d req-99da5ee5-238d-4934-865c-0e97af4ec41d service nova] Creating event network-vif-plugged:c3ddca4e-2887-4fd8-919d-7abc574f54f5 for instance f9d3d26f-4dd5-4068-bee2-60b3d1a71055 on hv-cinder-84178 May 13 17:29:01.501927 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b383982e-beaf-4091-a947-ad1e4bfcfe65 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1314 microversion: 2.1 time: 0.651695 May 13 17:29:01.502216 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-0d27a712-1b30-46e3-994b-17fc5724792d req-99da5ee5-238d-4934-865c-0e97af4ec41d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050427 May 13 17:29:01.503683 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 174/346] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:00 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1314 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:01.512834 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 173/347] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:29:01.651072 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9e3bb175-368f-4e60-abaa-d347d6c12021 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:01.654373 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9e3bb175-368f-4e60-abaa-d347d6c12021 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:01.662904 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9e3bb175-368f-4e60-abaa-d347d6c12021 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:01.663810 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9e3bb175-368f-4e60-abaa-d347d6c12021 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:01.665036 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9e3bb175-368f-4e60-abaa-d347d6c12021 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:01.665745 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9e3bb175-368f-4e60-abaa-d347d6c12021 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:02.365901 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9e3bb175-368f-4e60-abaa-d347d6c12021 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:02.374158 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9e3bb175-368f-4e60-abaa-d347d6c12021 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1322 microversion: 2.1 time: 0.727137 May 13 17:29:02.379314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 175/348] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:01 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1322 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:02.521754 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d12df9e6-e1ff-4ac0-8ee4-a2a449abfb8f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:02.522463 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d12df9e6-e1ff-4ac0-8ee4-a2a449abfb8f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:02.542026 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d12df9e6-e1ff-4ac0-8ee4-a2a449abfb8f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:02.542876 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d12df9e6-e1ff-4ac0-8ee4-a2a449abfb8f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:02.543964 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d12df9e6-e1ff-4ac0-8ee4-a2a449abfb8f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:02.544508 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d12df9e6-e1ff-4ac0-8ee4-a2a449abfb8f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:02.767401 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d12df9e6-e1ff-4ac0-8ee4-a2a449abfb8f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:02.785300 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d12df9e6-e1ff-4ac0-8ee4-a2a449abfb8f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1314 microversion: 2.1 time: 0.269390 May 13 17:29:02.789284 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 174/349] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:02 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:03.394885 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-67e6af00-e9ca-4dd5-83f0-ddd7d5715d17 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:03.396175 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-67e6af00-e9ca-4dd5-83f0-ddd7d5715d17 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:03.410797 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-67e6af00-e9ca-4dd5-83f0-ddd7d5715d17 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:03.412298 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-67e6af00-e9ca-4dd5-83f0-ddd7d5715d17 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:03.413102 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-67e6af00-e9ca-4dd5-83f0-ddd7d5715d17 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:03.413484 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-67e6af00-e9ca-4dd5-83f0-ddd7d5715d17 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:03.625640 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-67e6af00-e9ca-4dd5-83f0-ddd7d5715d17 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:03.636921 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-67e6af00-e9ca-4dd5-83f0-ddd7d5715d17 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1322 microversion: 2.1 time: 0.245859 May 13 17:29:03.638723 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 176/350] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:03 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:03.804251 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-2450f3ac-f03c-4d99-8a17-5ae6b0d1d85a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:03.804792 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-2450f3ac-f03c-4d99-8a17-5ae6b0d1d85a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:03.812840 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2450f3ac-f03c-4d99-8a17-5ae6b0d1d85a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:03.817098 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2450f3ac-f03c-4d99-8a17-5ae6b0d1d85a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:03.818100 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2450f3ac-f03c-4d99-8a17-5ae6b0d1d85a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:03.819065 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2450f3ac-f03c-4d99-8a17-5ae6b0d1d85a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:04.053421 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-2450f3ac-f03c-4d99-8a17-5ae6b0d1d85a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:04.070822 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-2450f3ac-f03c-4d99-8a17-5ae6b0d1d85a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1314 microversion: 2.1 time: 0.269716 May 13 17:29:04.071464 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 175/351] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:03 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:04.660224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ea27a951-4155-437e-979b-994223430e99 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:04.661564 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ea27a951-4155-437e-979b-994223430e99 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:04.684687 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ea27a951-4155-437e-979b-994223430e99 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:04.688175 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ea27a951-4155-437e-979b-994223430e99 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:04.689194 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ea27a951-4155-437e-979b-994223430e99 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:04.691874 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ea27a951-4155-437e-979b-994223430e99 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:05.045991 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ea27a951-4155-437e-979b-994223430e99 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:05.064221 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ea27a951-4155-437e-979b-994223430e99 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1516 microversion: 2.1 time: 0.409039 May 13 17:29:05.068485 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 177/352] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:04 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1516 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:05.083389 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7b3d77f3-9e1a-48b4-a179-7e28c56aa4f2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:29:05.084774 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7b3d77f3-9e1a-48b4-a179-7e28c56aa4f2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:05.099972 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-24b70ffc-feac-421d-a956-fd22fd30f08e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:05.101156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-24b70ffc-feac-421d-a956-fd22fd30f08e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:05.104228 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7b3d77f3-9e1a-48b4-a179-7e28c56aa4f2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:05.108462 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7b3d77f3-9e1a-48b4-a179-7e28c56aa4f2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:05.110969 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7b3d77f3-9e1a-48b4-a179-7e28c56aa4f2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:05.113192 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7b3d77f3-9e1a-48b4-a179-7e28c56aa4f2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:05.117350 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-24b70ffc-feac-421d-a956-fd22fd30f08e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:05.118015 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-24b70ffc-feac-421d-a956-fd22fd30f08e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:05.120289 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-24b70ffc-feac-421d-a956-fd22fd30f08e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:05.121809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-24b70ffc-feac-421d-a956-fd22fd30f08e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:05.174404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.objects.instance [None req-7b3d77f3-9e1a-48b4-a179-7e28c56aa4f2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lazy-loading 'flavor' on Instance uuid f9d3d26f-4dd5-4068-bee2-60b3d1a71055 {{(pid=117492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:29:05.325240 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-24b70ffc-feac-421d-a956-fd22fd30f08e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:05.334120 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-24b70ffc-feac-421d-a956-fd22fd30f08e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1314 microversion: 2.1 time: 0.249430 May 13 17:29:05.335419 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 178/353] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:05 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:05.382632 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-7c758902-d192-4c52-bc49-8dcd46613f5b req-bce49717-521f-4ba9-b15a-241908a4306a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc", "name": "network-vif-plugged", "status": "completed", "tag": "fb94ca7c-01fc-441c-a41a-2b1ad50471cb"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:29:05.402558 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-7c758902-d192-4c52-bc49-8dcd46613f5b req-bce49717-521f-4ba9-b15a-241908a4306a service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:05.403323 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-7c758902-d192-4c52-bc49-8dcd46613f5b req-bce49717-521f-4ba9-b15a-241908a4306a service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:05.434147 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-7c758902-d192-4c52-bc49-8dcd46613f5b req-bce49717-521f-4ba9-b15a-241908a4306a service nova] Creating event network-vif-plugged:fb94ca7c-01fc-441c-a41a-2b1ad50471cb for instance bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc on hv-cinder-84178 May 13 17:29:05.443218 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-7c758902-d192-4c52-bc49-8dcd46613f5b req-bce49717-521f-4ba9-b15a-241908a4306a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065489 May 13 17:29:05.446955 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 179/354] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:29:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:29:05.574480 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7b3d77f3-9e1a-48b4-a179-7e28c56aa4f2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "POST /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055/action" status: 200 len: 32 microversion: 2.1 time: 0.495884 May 13 17:29:05.575711 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 176/355] 10.222.0.64 () {60 vars in 1277 bytes} [Fri May 13 17:29:05 2022] POST /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055/action => generated 32 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 17:29:05.589913 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6b44109b-9d2f-48fb-b6bd-f7c105de299d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:05.590899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6b44109b-9d2f-48fb-b6bd-f7c105de299d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:05.610523 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b44109b-9d2f-48fb-b6bd-f7c105de299d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:05.618191 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b44109b-9d2f-48fb-b6bd-f7c105de299d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:05.619403 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b44109b-9d2f-48fb-b6bd-f7c105de299d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:05.620136 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b44109b-9d2f-48fb-b6bd-f7c105de299d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:06.206842 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6b44109b-9d2f-48fb-b6bd-f7c105de299d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:06.216104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6b44109b-9d2f-48fb-b6bd-f7c105de299d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.635417 May 13 17:29:06.226644 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 180/356] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:05 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:06.353270 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-bc3cccf7-6c58-4f30-9fc8-aaaa50fa9a6a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:06.354593 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-bc3cccf7-6c58-4f30-9fc8-aaaa50fa9a6a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:06.372076 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bc3cccf7-6c58-4f30-9fc8-aaaa50fa9a6a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:06.372523 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bc3cccf7-6c58-4f30-9fc8-aaaa50fa9a6a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:06.373498 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bc3cccf7-6c58-4f30-9fc8-aaaa50fa9a6a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:06.373932 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bc3cccf7-6c58-4f30-9fc8-aaaa50fa9a6a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:06.618397 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-bc3cccf7-6c58-4f30-9fc8-aaaa50fa9a6a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:06.630523 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-bc3cccf7-6c58-4f30-9fc8-aaaa50fa9a6a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1314 microversion: 2.1 time: 0.282354 May 13 17:29:06.631120 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 177/357] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:06 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1314 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:07.234650 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7d1e41cc-85bd-4998-9799-59bbf4e30c22 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:07.235939 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7d1e41cc-85bd-4998-9799-59bbf4e30c22 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:07.253952 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7d1e41cc-85bd-4998-9799-59bbf4e30c22 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:07.254779 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7d1e41cc-85bd-4998-9799-59bbf4e30c22 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:07.255760 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7d1e41cc-85bd-4998-9799-59bbf4e30c22 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:07.258788 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7d1e41cc-85bd-4998-9799-59bbf4e30c22 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:07.590022 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7d1e41cc-85bd-4998-9799-59bbf4e30c22 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:07.601543 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7d1e41cc-85bd-4998-9799-59bbf4e30c22 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.371189 May 13 17:29:07.602118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 181/358] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:07 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:07.647849 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-e15d606d-a701-49dc-95d3-e7b945dccff9 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:07.651471 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-e15d606d-a701-49dc-95d3-e7b945dccff9 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:07.666298 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e15d606d-a701-49dc-95d3-e7b945dccff9 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:07.666753 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e15d606d-a701-49dc-95d3-e7b945dccff9 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:07.675759 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e15d606d-a701-49dc-95d3-e7b945dccff9 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:07.678881 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e15d606d-a701-49dc-95d3-e7b945dccff9 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:07.942869 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-e15d606d-a701-49dc-95d3-e7b945dccff9 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:07.954253 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-e15d606d-a701-49dc-95d3-e7b945dccff9 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1314 microversion: 2.1 time: 0.310811 May 13 17:29:07.968705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 178/359] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:07 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:08.621367 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-53cdd262-446a-4d9e-a5ca-19e21b6087bf tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:08.625285 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-53cdd262-446a-4d9e-a5ca-19e21b6087bf tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:08.629791 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-53cdd262-446a-4d9e-a5ca-19e21b6087bf tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:08.630627 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-53cdd262-446a-4d9e-a5ca-19e21b6087bf tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:08.631606 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-53cdd262-446a-4d9e-a5ca-19e21b6087bf tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:08.632305 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-53cdd262-446a-4d9e-a5ca-19e21b6087bf tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:08.985207 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-87f7a055-fef5-400a-a196-9a2fa62d0b2c tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:08.985820 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-87f7a055-fef5-400a-a196-9a2fa62d0b2c tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:08.998251 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-87f7a055-fef5-400a-a196-9a2fa62d0b2c tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:09.000315 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-87f7a055-fef5-400a-a196-9a2fa62d0b2c tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:09.004424 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-87f7a055-fef5-400a-a196-9a2fa62d0b2c tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:09.004905 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-87f7a055-fef5-400a-a196-9a2fa62d0b2c tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:09.009166 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-53cdd262-446a-4d9e-a5ca-19e21b6087bf tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:09.016754 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-53cdd262-446a-4d9e-a5ca-19e21b6087bf tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.401981 May 13 17:29:09.027483 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 182/360] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:08 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:09.638189 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-87f7a055-fef5-400a-a196-9a2fa62d0b2c tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:09.646263 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-87f7a055-fef5-400a-a196-9a2fa62d0b2c tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1498 microversion: 2.1 time: 0.665296 May 13 17:29:09.650129 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 179/361] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:08 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1498 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:10.037634 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ed94910c-99e1-49cd-9be1-a85b525df65f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:10.042378 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ed94910c-99e1-49cd-9be1-a85b525df65f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:10.047092 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ed94910c-99e1-49cd-9be1-a85b525df65f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:10.047765 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ed94910c-99e1-49cd-9be1-a85b525df65f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:10.048698 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ed94910c-99e1-49cd-9be1-a85b525df65f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:10.049310 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ed94910c-99e1-49cd-9be1-a85b525df65f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:10.255849 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ed94910c-99e1-49cd-9be1-a85b525df65f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:10.264494 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ed94910c-99e1-49cd-9be1-a85b525df65f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.230587 May 13 17:29:10.271708 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 183/362] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:10 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:11.281909 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-52553de2-a265-44e2-a005-c051e5f710f0 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:11.283211 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-52553de2-a265-44e2-a005-c051e5f710f0 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:11.291156 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-52553de2-a265-44e2-a005-c051e5f710f0 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:11.291606 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-52553de2-a265-44e2-a005-c051e5f710f0 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:11.292585 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-52553de2-a265-44e2-a005-c051e5f710f0 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:11.293985 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-52553de2-a265-44e2-a005-c051e5f710f0 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:11.541928 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-52553de2-a265-44e2-a005-c051e5f710f0 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:11.550434 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-52553de2-a265-44e2-a005-c051e5f710f0 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.272448 May 13 17:29:11.551301 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 180/363] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:11 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:12.047409 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-223d991c-71fe-45c0-8245-9785aee9276a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Action: 'create', calling method: .version_select at 0x7fa084526700>, body: {"keypair": {"name": "tempest-TestShelveInstance-442032391", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKO4QuhCERItC1hNWi0251IT1LtfOMBipKncx2dszW+PWs98H7BUbadyKeF+VNra1JcOtuksnOA7swqbn4haY6XHnBm+J+EFurf1nWgiPkD5365cuq0p3+sn5IomZkzIMA=="}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:29:12.063747 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-223d991c-71fe-45c0-8245-9785aee9276a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Getting quotas for project 15f2d05b5ad248009d2acb0d3db6aec9. Resources: {'key_pairs'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:29:12.068876 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-223d991c-71fe-45c0-8245-9785aee9276a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Getting quotas for user 72919bd9efe84fa8acf2b407d7b6b13d and project 15f2d05b5ad248009d2acb0d3db6aec9. Resources: {'key_pairs'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:29:12.204817 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-223d991c-71fe-45c0-8245-9785aee9276a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.386790 May 13 17:29:12.206118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 184/364] 10.222.0.64 () {60 vars in 1158 bytes} [Fri May 13 17:29:11 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:29:12.566711 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a16816a9-e667-4db1-bec4-84ecc8f25221 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:12.567432 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a16816a9-e667-4db1-bec4-84ecc8f25221 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:12.574011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a16816a9-e667-4db1-bec4-84ecc8f25221 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:12.574397 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a16816a9-e667-4db1-bec4-84ecc8f25221 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:12.575213 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a16816a9-e667-4db1-bec4-84ecc8f25221 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:12.576073 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a16816a9-e667-4db1-bec4-84ecc8f25221 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:12.724789 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a16816a9-e667-4db1-bec4-84ecc8f25221 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:12.732409 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a16816a9-e667-4db1-bec4-84ecc8f25221 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.169688 May 13 17:29:12.732995 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 181/365] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:12 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:12.818707 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ce979e0c-4064-4b31-9dc7-2e45dfa77ece tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Action: 'create', calling method: .version_select at 0x7fa084529670>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1325480932", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIv4pgzedyXxCMLpXq3M9mK0rjOE6VXmbCnqbqu47+G/EncE6Yqd90ehQmX9uavo4w4r2C66SgAV1XkIoCDvgO2l72VJh9SzJvMyANDMAlyCq4sznvpmUyvSD2kCdpzdOQ=="}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:29:12.839592 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-ce979e0c-4064-4b31-9dc7-2e45dfa77ece tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Getting quotas for project aff066fb75f04eb7bb9b16dea32b270d. Resources: {'key_pairs'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:29:12.844416 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-ce979e0c-4064-4b31-9dc7-2e45dfa77ece tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Getting quotas for user bf8f7f47fe6c4a88b415ec21b36fcdd9 and project aff066fb75f04eb7bb9b16dea32b270d. Resources: {'key_pairs'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:29:12.899024 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-c9b11092-0921-4c61-8b50-a841b50de0f4 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:12.899557 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-c9b11092-0921-4c61-8b50-a841b50de0f4 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:12.905972 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c9b11092-0921-4c61-8b50-a841b50de0f4 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:12.906708 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c9b11092-0921-4c61-8b50-a841b50de0f4 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:12.907770 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c9b11092-0921-4c61-8b50-a841b50de0f4 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:12.908217 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c9b11092-0921-4c61-8b50-a841b50de0f4 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:12.937185 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-c9b11092-0921-4c61-8b50-a841b50de0f4 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Going to try to terminate instance {{(pid=117492) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 17:29:12.944406 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ce979e0c-4064-4b31-9dc7-2e45dfa77ece tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.129260 May 13 17:29:12.955168 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 185/366] 10.222.0.64 () {60 vars in 1158 bytes} [Fri May 13 17:29:12 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:29:13.067919 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2cda1974-7ef2-4151-a38d-86d56c5d4f5d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1941755923", "imageRef": "d5c6fbbd-5cea-4f57-9f0c-5742482d1a4c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1325480932", "networks": [{"uuid": "9cd1f104-2ed2-40ab-be68-4e5ad88257b1"}]}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:29:13.125244 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.network.neutron [None req-2cda1974-7ef2-4151-a38d-86d56c5d4f5d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] validate_networks() for [('9cd1f104-2ed2-40ab-be68-4e5ad88257b1', None, None, None, None, None)] {{(pid=117493) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 17:29:13.277438 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-c9b11092-0921-4c61-8b50-a841b50de0f4 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "DELETE /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 204 len: 0 microversion: 2.1 time: 0.382233 May 13 17:29:13.278059 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 182/367] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:29:12 2022] DELETE /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 0 bytes in 384 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 13 17:29:13.287566 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d3afd2dc-4583-4b80-ac9c-ad6c81c9403a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:13.288534 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d3afd2dc-4583-4b80-ac9c-ad6c81c9403a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:13.295824 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d3afd2dc-4583-4b80-ac9c-ad6c81c9403a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:13.296593 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d3afd2dc-4583-4b80-ac9c-ad6c81c9403a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:13.297725 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d3afd2dc-4583-4b80-ac9c-ad6c81c9403a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:13.298333 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d3afd2dc-4583-4b80-ac9c-ad6c81c9403a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:13.560690 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d3afd2dc-4583-4b80-ac9c-ad6c81c9403a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:13.574062 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d3afd2dc-4583-4b80-ac9c-ad6c81c9403a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1504 microversion: 2.1 time: 0.291401 May 13 17:29:13.574654 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 183/368] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:13 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1504 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:13.582603 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-2cda1974-7ef2-4151-a38d-86d56c5d4f5d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Flavor limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 17:29:13.583098 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-2cda1974-7ef2-4151-a38d-86d56c5d4f5d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Image limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 17:29:13.583613 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-2cda1974-7ef2-4151-a38d-86d56c5d4f5d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Flavor pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 17:29:13.584047 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-2cda1974-7ef2-4151-a38d-86d56c5d4f5d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Image pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 17:29:13.584457 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-2cda1974-7ef2-4151-a38d-86d56c5d4f5d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 17:29:13.596906 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2cda1974-7ef2-4151-a38d-86d56c5d4f5d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:13.596906 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2cda1974-7ef2-4151-a38d-86d56c5d4f5d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:13.596906 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2cda1974-7ef2-4151-a38d-86d56c5d4f5d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:13.596906 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2cda1974-7ef2-4151-a38d-86d56c5d4f5d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:13.611303 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-2cda1974-7ef2-4151-a38d-86d56c5d4f5d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Getting quotas for project aff066fb75f04eb7bb9b16dea32b270d. Resources: {'ram', 'instances', 'cores'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:29:13.615781 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-2cda1974-7ef2-4151-a38d-86d56c5d4f5d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Getting quotas for user bf8f7f47fe6c4a88b415ec21b36fcdd9 and project aff066fb75f04eb7bb9b16dea32b270d. Resources: {'ram', 'instances', 'cores'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:29:13.631867 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2cda1974-7ef2-4151-a38d-86d56c5d4f5d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Going to run 1 instances... {{(pid=117493) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 17:29:13.634290 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2cda1974-7ef2-4151-a38d-86d56c5d4f5d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d5c6fbbd-5cea-4f57-9f0c-5742482d1a4c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 17:29:13.749475 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1d704934-9b5e-4ca8-a082-f62f59a70632 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:13.750694 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-1d704934-9b5e-4ca8-a082-f62f59a70632 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:13.754862 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2cda1974-7ef2-4151-a38d-86d56c5d4f5d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.691352 May 13 17:29:13.756025 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 186/369] 10.222.0.64 () {60 vars in 1146 bytes} [Fri May 13 17:29:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 17:29:13.757626 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1d704934-9b5e-4ca8-a082-f62f59a70632 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:13.758080 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1d704934-9b5e-4ca8-a082-f62f59a70632 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:13.758854 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1d704934-9b5e-4ca8-a082-f62f59a70632 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:13.759325 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1d704934-9b5e-4ca8-a082-f62f59a70632 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:13.765587 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ff7923fb-1508-4a8e-a4af-3d89c0a6f4c6 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:13.766204 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ff7923fb-1508-4a8e-a4af-3d89c0a6f4c6 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:13.825718 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ff7923fb-1508-4a8e-a4af-3d89c0a6f4c6 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:13.838453 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ff7923fb-1508-4a8e-a4af-3d89c0a6f4c6 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1259 microversion: 2.1 time: 0.076846 May 13 17:29:13.839032 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 187/370] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:13 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1259 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:13.979379 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-1d704934-9b5e-4ca8-a082-f62f59a70632 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:13.989254 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-1d704934-9b5e-4ca8-a082-f62f59a70632 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.243591 May 13 17:29:13.989942 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 184/371] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:13 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:14.592055 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1c492bd9-fa42-4399-83cd-9ae2e4b4b362 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:14.593159 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1c492bd9-fa42-4399-83cd-9ae2e4b4b362 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:14.606215 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1c492bd9-fa42-4399-83cd-9ae2e4b4b362 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:14.607171 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1c492bd9-fa42-4399-83cd-9ae2e4b4b362 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:14.608179 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1c492bd9-fa42-4399-83cd-9ae2e4b4b362 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:14.612630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1c492bd9-fa42-4399-83cd-9ae2e4b4b362 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:14.746908 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1c492bd9-fa42-4399-83cd-9ae2e4b4b362 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:14.755961 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1c492bd9-fa42-4399-83cd-9ae2e4b4b362 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1504 microversion: 2.1 time: 0.168098 May 13 17:29:14.756677 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 188/372] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:14 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1504 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:14.861846 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-681c5ee1-acbe-412e-a449-e705ce59d4ba tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:14.863018 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-681c5ee1-acbe-412e-a449-e705ce59d4ba tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:14.926605 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-681c5ee1-acbe-412e-a449-e705ce59d4ba tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:14.933816 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-681c5ee1-acbe-412e-a449-e705ce59d4ba tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1259 microversion: 2.1 time: 0.075768 May 13 17:29:14.936831 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 185/373] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:14 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1259 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:15.011766 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-914b89fa-6d73-47e1-9b21-75ed2e180920 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:15.014415 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-914b89fa-6d73-47e1-9b21-75ed2e180920 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:15.019230 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-914b89fa-6d73-47e1-9b21-75ed2e180920 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:15.019682 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-914b89fa-6d73-47e1-9b21-75ed2e180920 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:15.020462 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-914b89fa-6d73-47e1-9b21-75ed2e180920 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:15.020900 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-914b89fa-6d73-47e1-9b21-75ed2e180920 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:15.177413 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-914b89fa-6d73-47e1-9b21-75ed2e180920 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:15.184999 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-914b89fa-6d73-47e1-9b21-75ed2e180920 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.178190 May 13 17:29:15.191639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 189/374] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:15 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:15.773890 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d29fa787-78eb-4be1-8ecc-9b61eb42f901 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:15.774491 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d29fa787-78eb-4be1-8ecc-9b61eb42f901 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:15.780398 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d29fa787-78eb-4be1-8ecc-9b61eb42f901 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:15.780842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d29fa787-78eb-4be1-8ecc-9b61eb42f901 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:15.781595 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d29fa787-78eb-4be1-8ecc-9b61eb42f901 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:15.782021 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d29fa787-78eb-4be1-8ecc-9b61eb42f901 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:15.917399 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d29fa787-78eb-4be1-8ecc-9b61eb42f901 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:15.933699 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d29fa787-78eb-4be1-8ecc-9b61eb42f901 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1504 microversion: 2.1 time: 0.163560 May 13 17:29:15.934331 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 186/375] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:15 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1504 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:15.951446 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f90d52a2-0ba9-40ef-89ad-c06d0afe9c0a tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:15.952055 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f90d52a2-0ba9-40ef-89ad-c06d0afe9c0a tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:15.962920 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f90d52a2-0ba9-40ef-89ad-c06d0afe9c0a tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:15.962920 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f90d52a2-0ba9-40ef-89ad-c06d0afe9c0a tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:15.962920 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f90d52a2-0ba9-40ef-89ad-c06d0afe9c0a tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:15.962920 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f90d52a2-0ba9-40ef-89ad-c06d0afe9c0a tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:16.029179 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f90d52a2-0ba9-40ef-89ad-c06d0afe9c0a tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:16.036609 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f90d52a2-0ba9-40ef-89ad-c06d0afe9c0a tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1263 microversion: 2.1 time: 0.089129 May 13 17:29:16.037180 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 190/376] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:15 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1263 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:16.203310 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-bfee5d85-aae1-4a71-8c5a-52fcda6e5d12 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:16.203874 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-bfee5d85-aae1-4a71-8c5a-52fcda6e5d12 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:16.210889 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bfee5d85-aae1-4a71-8c5a-52fcda6e5d12 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:16.211383 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bfee5d85-aae1-4a71-8c5a-52fcda6e5d12 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:16.212190 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bfee5d85-aae1-4a71-8c5a-52fcda6e5d12 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:16.212650 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bfee5d85-aae1-4a71-8c5a-52fcda6e5d12 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:16.342894 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-bfee5d85-aae1-4a71-8c5a-52fcda6e5d12 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:16.350401 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-bfee5d85-aae1-4a71-8c5a-52fcda6e5d12 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.151241 May 13 17:29:16.350975 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 187/377] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:16 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:16.950394 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-aea4009b-d36e-4a59-a687-2a1c112e5dad tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:16.951084 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-aea4009b-d36e-4a59-a687-2a1c112e5dad tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:16.960104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aea4009b-d36e-4a59-a687-2a1c112e5dad tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:16.960648 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aea4009b-d36e-4a59-a687-2a1c112e5dad tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:16.963888 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aea4009b-d36e-4a59-a687-2a1c112e5dad tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:16.964448 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aea4009b-d36e-4a59-a687-2a1c112e5dad tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:17.053259 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-c68bddcb-9744-40c0-a6e6-415c26cd1456 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:17.053869 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-c68bddcb-9744-40c0-a6e6-415c26cd1456 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:17.060055 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c68bddcb-9744-40c0-a6e6-415c26cd1456 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:17.060502 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c68bddcb-9744-40c0-a6e6-415c26cd1456 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:17.061269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c68bddcb-9744-40c0-a6e6-415c26cd1456 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:17.061703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c68bddcb-9744-40c0-a6e6-415c26cd1456 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:17.096511 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-aea4009b-d36e-4a59-a687-2a1c112e5dad tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:17.103868 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-aea4009b-d36e-4a59-a687-2a1c112e5dad tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1504 microversion: 2.1 time: 0.157254 May 13 17:29:17.104439 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 191/378] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:16 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:17.124298 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c68bddcb-9744-40c0-a6e6-415c26cd1456 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:17.132200 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-c68bddcb-9744-40c0-a6e6-415c26cd1456 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1263 microversion: 2.1 time: 0.082733 May 13 17:29:17.132754 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 188/379] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:17 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1263 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:17.367348 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5fe3cacc-1a35-4412-b8be-df267f57055c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:17.367956 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5fe3cacc-1a35-4412-b8be-df267f57055c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:17.373654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5fe3cacc-1a35-4412-b8be-df267f57055c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:17.374105 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5fe3cacc-1a35-4412-b8be-df267f57055c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:17.374862 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5fe3cacc-1a35-4412-b8be-df267f57055c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:17.375330 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5fe3cacc-1a35-4412-b8be-df267f57055c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:17.534746 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5fe3cacc-1a35-4412-b8be-df267f57055c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:17.543424 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5fe3cacc-1a35-4412-b8be-df267f57055c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.179695 May 13 17:29:17.546497 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 192/380] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:17 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:18.120777 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1a194532-1250-4720-a069-ec149a322910 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:18.121518 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-1a194532-1250-4720-a069-ec149a322910 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:18.128160 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1a194532-1250-4720-a069-ec149a322910 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:18.128632 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1a194532-1250-4720-a069-ec149a322910 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:18.129400 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1a194532-1250-4720-a069-ec149a322910 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:18.129838 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1a194532-1250-4720-a069-ec149a322910 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:18.148687 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a3e6e430-ff03-4bbd-a9be-ed694099ba7f tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:18.149403 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a3e6e430-ff03-4bbd-a9be-ed694099ba7f tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:18.155539 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a3e6e430-ff03-4bbd-a9be-ed694099ba7f tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:18.156057 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a3e6e430-ff03-4bbd-a9be-ed694099ba7f tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:18.156940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a3e6e430-ff03-4bbd-a9be-ed694099ba7f tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:18.157467 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a3e6e430-ff03-4bbd-a9be-ed694099ba7f tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:18.223012 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a3e6e430-ff03-4bbd-a9be-ed694099ba7f tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:18.232575 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a3e6e430-ff03-4bbd-a9be-ed694099ba7f tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1255 microversion: 2.1 time: 0.087685 May 13 17:29:18.233202 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 193/381] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:18 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1255 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:18.283578 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-1a194532-1250-4720-a069-ec149a322910 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:18.290991 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-1a194532-1250-4720-a069-ec149a322910 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1504 microversion: 2.1 time: 0.174170 May 13 17:29:18.291794 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 189/382] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:18 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1504 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:18.560405 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a1046335-d698-4b4a-9bb4-fa9fe10e7413 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:18.561345 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a1046335-d698-4b4a-9bb4-fa9fe10e7413 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:18.572626 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a1046335-d698-4b4a-9bb4-fa9fe10e7413 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:18.573275 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a1046335-d698-4b4a-9bb4-fa9fe10e7413 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:18.574067 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a1046335-d698-4b4a-9bb4-fa9fe10e7413 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:18.574538 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a1046335-d698-4b4a-9bb4-fa9fe10e7413 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:18.706721 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a1046335-d698-4b4a-9bb4-fa9fe10e7413 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:18.713974 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a1046335-d698-4b4a-9bb4-fa9fe10e7413 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.157791 May 13 17:29:18.714549 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 194/383] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:18 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:19.251250 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-c024ef63-9ef9-445f-9e02-5cb032d27177 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:19.251802 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-c024ef63-9ef9-445f-9e02-5cb032d27177 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:19.258597 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c024ef63-9ef9-445f-9e02-5cb032d27177 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:19.259043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c024ef63-9ef9-445f-9e02-5cb032d27177 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:19.259850 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c024ef63-9ef9-445f-9e02-5cb032d27177 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:19.260288 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c024ef63-9ef9-445f-9e02-5cb032d27177 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:19.308566 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0316e8ac-8572-45dc-a40c-58d69769ea77 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:19.309273 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0316e8ac-8572-45dc-a40c-58d69769ea77 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:19.315943 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0316e8ac-8572-45dc-a40c-58d69769ea77 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:19.316464 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0316e8ac-8572-45dc-a40c-58d69769ea77 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:19.317282 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0316e8ac-8572-45dc-a40c-58d69769ea77 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:19.318099 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0316e8ac-8572-45dc-a40c-58d69769ea77 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:19.327206 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c024ef63-9ef9-445f-9e02-5cb032d27177 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:19.336817 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-c024ef63-9ef9-445f-9e02-5cb032d27177 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1319 microversion: 2.1 time: 0.090052 May 13 17:29:19.337657 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 190/384] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:19 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1319 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:19.717622 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0316e8ac-8572-45dc-a40c-58d69769ea77 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:19.727212 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0316e8ac-8572-45dc-a40c-58d69769ea77 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1504 microversion: 2.1 time: 0.422538 May 13 17:29:19.732085 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-5a859260-6f43-4ffc-96ff-fe3a23676012 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:19.733102 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-5a859260-6f43-4ffc-96ff-fe3a23676012 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:19.738620 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 195/385] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:19 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1504 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:19.742520 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5a859260-6f43-4ffc-96ff-fe3a23676012 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:19.743297 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5a859260-6f43-4ffc-96ff-fe3a23676012 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:19.744274 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5a859260-6f43-4ffc-96ff-fe3a23676012 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:19.749752 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5a859260-6f43-4ffc-96ff-fe3a23676012 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:19.889174 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-5a859260-6f43-4ffc-96ff-fe3a23676012 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:19.897987 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-5a859260-6f43-4ffc-96ff-fe3a23676012 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.170653 May 13 17:29:19.898760 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 191/386] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:19 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:20.356045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-eb513283-d328-4091-8766-7920e445d213 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:20.356558 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-eb513283-d328-4091-8766-7920e445d213 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:20.363989 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eb513283-d328-4091-8766-7920e445d213 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:20.364654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eb513283-d328-4091-8766-7920e445d213 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:20.365826 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eb513283-d328-4091-8766-7920e445d213 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:20.366785 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eb513283-d328-4091-8766-7920e445d213 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:20.452016 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-eb513283-d328-4091-8766-7920e445d213 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:20.468338 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-eb513283-d328-4091-8766-7920e445d213 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1317 microversion: 2.1 time: 0.116035 May 13 17:29:20.469517 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 196/387] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:20 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1317 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:20.572067 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-df4f657b-fcd2-4ece-9224-27646b0ce0ee req-cc4e3388-02cf-46b1-8f14-ed4082a0cb1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc", "name": "network-vif-deleted", "tag": "fb94ca7c-01fc-441c-a41a-2b1ad50471cb"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:29:20.601267 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-df4f657b-fcd2-4ece-9224-27646b0ce0ee req-cc4e3388-02cf-46b1-8f14-ed4082a0cb1f service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:20.601718 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-df4f657b-fcd2-4ece-9224-27646b0ce0ee req-cc4e3388-02cf-46b1-8f14-ed4082a0cb1f service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:20.615293 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-df4f657b-fcd2-4ece-9224-27646b0ce0ee req-cc4e3388-02cf-46b1-8f14-ed4082a0cb1f service nova] Creating event network-vif-deleted:fb94ca7c-01fc-441c-a41a-2b1ad50471cb for instance bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc on hv-cinder-84178 May 13 17:29:20.621590 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-df4f657b-fcd2-4ece-9224-27646b0ce0ee req-cc4e3388-02cf-46b1-8f14-ed4082a0cb1f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053474 May 13 17:29:20.623284 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 192/388] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:29:20.746449 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b806f837-5b83-4bdf-871a-b9524e85c351 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:20.747293 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b806f837-5b83-4bdf-871a-b9524e85c351 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:20.753990 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b806f837-5b83-4bdf-871a-b9524e85c351 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:20.754730 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b806f837-5b83-4bdf-871a-b9524e85c351 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:20.755710 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b806f837-5b83-4bdf-871a-b9524e85c351 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:20.756316 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b806f837-5b83-4bdf-871a-b9524e85c351 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:20.833544 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b806f837-5b83-4bdf-871a-b9524e85c351 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:20.841701 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b806f837-5b83-4bdf-871a-b9524e85c351 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1462 microversion: 2.1 time: 0.099267 May 13 17:29:20.842663 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 197/389] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:20 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1462 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:20.915521 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-57f13e52-fd1d-482e-92b2-54bab7b50c4e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:20.921441 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-57f13e52-fd1d-482e-92b2-54bab7b50c4e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:20.929711 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-57f13e52-fd1d-482e-92b2-54bab7b50c4e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:20.934252 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-57f13e52-fd1d-482e-92b2-54bab7b50c4e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:20.936400 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-57f13e52-fd1d-482e-92b2-54bab7b50c4e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:20.937389 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-57f13e52-fd1d-482e-92b2-54bab7b50c4e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:21.159282 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-57f13e52-fd1d-482e-92b2-54bab7b50c4e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:21.168091 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-57f13e52-fd1d-482e-92b2-54bab7b50c4e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.256675 May 13 17:29:21.168684 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 193/390] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:20 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:21.485828 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c7be8fbc-b3a7-4c43-b536-19d94a117a28 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:21.486444 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c7be8fbc-b3a7-4c43-b536-19d94a117a28 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:21.492477 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c7be8fbc-b3a7-4c43-b536-19d94a117a28 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:21.493108 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c7be8fbc-b3a7-4c43-b536-19d94a117a28 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:21.500127 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c7be8fbc-b3a7-4c43-b536-19d94a117a28 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:21.500127 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c7be8fbc-b3a7-4c43-b536-19d94a117a28 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:21.653481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c7be8fbc-b3a7-4c43-b536-19d94a117a28 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:21.660927 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c7be8fbc-b3a7-4c43-b536-19d94a117a28 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.178909 May 13 17:29:21.666066 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 198/391] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:21 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:21.860610 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7fd41640-ed8e-4fd1-be42-6584ca91aa84 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:21.861749 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7fd41640-ed8e-4fd1-be42-6584ca91aa84 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:21.873087 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7fd41640-ed8e-4fd1-be42-6584ca91aa84 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:21.873535 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7fd41640-ed8e-4fd1-be42-6584ca91aa84 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:21.878909 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7fd41640-ed8e-4fd1-be42-6584ca91aa84 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:21.878909 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7fd41640-ed8e-4fd1-be42-6584ca91aa84 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:21.955506 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7fd41640-ed8e-4fd1-be42-6584ca91aa84 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:21.963884 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7fd41640-ed8e-4fd1-be42-6584ca91aa84 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1462 microversion: 2.1 time: 0.108097 May 13 17:29:21.964507 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 194/392] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:21 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1462 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:22.185703 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a9bb1f83-9137-456c-bcf3-51ba88fb545f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:22.186315 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a9bb1f83-9137-456c-bcf3-51ba88fb545f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:22.193029 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a9bb1f83-9137-456c-bcf3-51ba88fb545f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:22.193550 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a9bb1f83-9137-456c-bcf3-51ba88fb545f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:22.194368 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a9bb1f83-9137-456c-bcf3-51ba88fb545f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:22.194805 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a9bb1f83-9137-456c-bcf3-51ba88fb545f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:22.336401 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a9bb1f83-9137-456c-bcf3-51ba88fb545f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:22.343658 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a9bb1f83-9137-456c-bcf3-51ba88fb545f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.161862 May 13 17:29:22.344223 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 199/393] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:22 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:22.678350 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-bd0d0fa2-3ff1-4c4c-b81e-d76efd3fc31e tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:22.679071 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-bd0d0fa2-3ff1-4c4c-b81e-d76efd3fc31e tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:22.685979 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bd0d0fa2-3ff1-4c4c-b81e-d76efd3fc31e tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:22.686949 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bd0d0fa2-3ff1-4c4c-b81e-d76efd3fc31e tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:22.690434 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bd0d0fa2-3ff1-4c4c-b81e-d76efd3fc31e tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:22.691119 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bd0d0fa2-3ff1-4c4c-b81e-d76efd3fc31e tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:22.839286 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-bd0d0fa2-3ff1-4c4c-b81e-d76efd3fc31e tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:22.847840 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-bd0d0fa2-3ff1-4c4c-b81e-d76efd3fc31e tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.173389 May 13 17:29:22.848680 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 195/394] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:22 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:22.981995 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d2e7eb6e-a874-40ed-bb50-9a020c9b7fb2 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:22.982677 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d2e7eb6e-a874-40ed-bb50-9a020c9b7fb2 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:22.989061 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d2e7eb6e-a874-40ed-bb50-9a020c9b7fb2 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:22.989519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d2e7eb6e-a874-40ed-bb50-9a020c9b7fb2 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:22.990303 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d2e7eb6e-a874-40ed-bb50-9a020c9b7fb2 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:22.991621 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d2e7eb6e-a874-40ed-bb50-9a020c9b7fb2 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:23.076548 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d2e7eb6e-a874-40ed-bb50-9a020c9b7fb2 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:23.085320 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d2e7eb6e-a874-40ed-bb50-9a020c9b7fb2 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1462 microversion: 2.1 time: 0.107349 May 13 17:29:23.085887 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 200/395] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:22 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1462 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:23.360903 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d45681dc-b0a4-48fd-ab4e-02e90b507698 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:23.361492 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d45681dc-b0a4-48fd-ab4e-02e90b507698 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:23.368661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d45681dc-b0a4-48fd-ab4e-02e90b507698 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:23.369460 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d45681dc-b0a4-48fd-ab4e-02e90b507698 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:23.370479 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d45681dc-b0a4-48fd-ab4e-02e90b507698 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:23.371152 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d45681dc-b0a4-48fd-ab4e-02e90b507698 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:23.508878 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d45681dc-b0a4-48fd-ab4e-02e90b507698 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:23.516632 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d45681dc-b0a4-48fd-ab4e-02e90b507698 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.159432 May 13 17:29:23.517435 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 196/396] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:23 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:23.867374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6f4394a3-3fab-4f5c-9021-a695183ee7bb tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:23.867977 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6f4394a3-3fab-4f5c-9021-a695183ee7bb tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:23.873911 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6f4394a3-3fab-4f5c-9021-a695183ee7bb tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:23.874362 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6f4394a3-3fab-4f5c-9021-a695183ee7bb tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:23.875138 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6f4394a3-3fab-4f5c-9021-a695183ee7bb tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:23.875587 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6f4394a3-3fab-4f5c-9021-a695183ee7bb tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:24.030087 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6f4394a3-3fab-4f5c-9021-a695183ee7bb tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:24.037797 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6f4394a3-3fab-4f5c-9021-a695183ee7bb tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.174840 May 13 17:29:24.038377 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 201/397] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:23 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:24.107042 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-ecee34e8-e4b2-486a-adf2-69e471d0fee0 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:24.108357 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-ecee34e8-e4b2-486a-adf2-69e471d0fee0 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:24.130294 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ecee34e8-e4b2-486a-adf2-69e471d0fee0 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:24.130770 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ecee34e8-e4b2-486a-adf2-69e471d0fee0 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:24.131668 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ecee34e8-e4b2-486a-adf2-69e471d0fee0 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:24.132109 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ecee34e8-e4b2-486a-adf2-69e471d0fee0 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:24.192824 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-ecee34e8-e4b2-486a-adf2-69e471d0fee0 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:24.200124 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-ecee34e8-e4b2-486a-adf2-69e471d0fee0 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1462 microversion: 2.1 time: 0.101338 May 13 17:29:24.200693 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 197/398] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:24 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1462 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:24.535244 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b2320512-0aa2-4be2-ae35-80944608c997 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:24.535844 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b2320512-0aa2-4be2-ae35-80944608c997 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:24.541715 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b2320512-0aa2-4be2-ae35-80944608c997 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:24.542160 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b2320512-0aa2-4be2-ae35-80944608c997 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:24.542928 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b2320512-0aa2-4be2-ae35-80944608c997 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:24.543410 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b2320512-0aa2-4be2-ae35-80944608c997 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:24.705398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b2320512-0aa2-4be2-ae35-80944608c997 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:24.713228 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b2320512-0aa2-4be2-ae35-80944608c997 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.182277 May 13 17:29:24.713792 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 202/399] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:24 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:25.056059 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-48820c8f-8ee5-437d-89de-6a412366298c tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:25.056658 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-48820c8f-8ee5-437d-89de-6a412366298c tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:25.074783 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-48820c8f-8ee5-437d-89de-6a412366298c tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:25.075286 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-48820c8f-8ee5-437d-89de-6a412366298c tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:25.077855 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-48820c8f-8ee5-437d-89de-6a412366298c tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:25.077855 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-48820c8f-8ee5-437d-89de-6a412366298c tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:25.216962 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ec1f8808-ff28-4517-90e5-c8e764c7a813 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:25.217680 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ec1f8808-ff28-4517-90e5-c8e764c7a813 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:25.220963 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-48820c8f-8ee5-437d-89de-6a412366298c tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:25.224454 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ec1f8808-ff28-4517-90e5-c8e764c7a813 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:25.224925 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ec1f8808-ff28-4517-90e5-c8e764c7a813 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:25.225680 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ec1f8808-ff28-4517-90e5-c8e764c7a813 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:25.226119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ec1f8808-ff28-4517-90e5-c8e764c7a813 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:25.228840 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-48820c8f-8ee5-437d-89de-6a412366298c tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.176669 May 13 17:29:25.229410 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 198/400] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:25 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:25.285852 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ec1f8808-ff28-4517-90e5-c8e764c7a813 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:25.293206 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ec1f8808-ff28-4517-90e5-c8e764c7a813 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1462 microversion: 2.1 time: 0.080073 May 13 17:29:25.293775 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 203/401] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:25 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1462 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:25.731586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-0a3d6423-1a76-4cb6-a8ed-092d562e3d82 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:25.732202 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-0a3d6423-1a76-4cb6-a8ed-092d562e3d82 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:25.738256 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0a3d6423-1a76-4cb6-a8ed-092d562e3d82 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:25.738707 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0a3d6423-1a76-4cb6-a8ed-092d562e3d82 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:25.739505 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0a3d6423-1a76-4cb6-a8ed-092d562e3d82 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:25.739949 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0a3d6423-1a76-4cb6-a8ed-092d562e3d82 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:25.875011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0a3d6423-1a76-4cb6-a8ed-092d562e3d82 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:25.883849 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-0a3d6423-1a76-4cb6-a8ed-092d562e3d82 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.156579 May 13 17:29:25.885358 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 199/402] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:25 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:26.246903 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-87578ce5-d892-45d6-9780-1c0f01e51879 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:26.247622 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-87578ce5-d892-45d6-9780-1c0f01e51879 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:26.253510 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-87578ce5-d892-45d6-9780-1c0f01e51879 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:26.253954 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-87578ce5-d892-45d6-9780-1c0f01e51879 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:26.254713 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-87578ce5-d892-45d6-9780-1c0f01e51879 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:26.255162 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-87578ce5-d892-45d6-9780-1c0f01e51879 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:26.311740 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-034c6a6e-c3c8-4676-ba30-5843a3b8842a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:26.312611 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-034c6a6e-c3c8-4676-ba30-5843a3b8842a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:26.320330 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-034c6a6e-c3c8-4676-ba30-5843a3b8842a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:26.321019 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-034c6a6e-c3c8-4676-ba30-5843a3b8842a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:26.322178 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-034c6a6e-c3c8-4676-ba30-5843a3b8842a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:26.322891 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-034c6a6e-c3c8-4676-ba30-5843a3b8842a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:26.394587 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-034c6a6e-c3c8-4676-ba30-5843a3b8842a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:26.402108 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-034c6a6e-c3c8-4676-ba30-5843a3b8842a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1462 microversion: 2.1 time: 0.094989 May 13 17:29:26.403011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 200/403] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:26 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1462 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:26.421178 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-87578ce5-d892-45d6-9780-1c0f01e51879 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:26.428887 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-87578ce5-d892-45d6-9780-1c0f01e51879 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.185841 May 13 17:29:26.430042 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 204/404] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:26 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:26.901334 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-e6cc1383-c42e-4361-8c7f-3e863d1827ed tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:26.901939 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-e6cc1383-c42e-4361-8c7f-3e863d1827ed tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:26.907912 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e6cc1383-c42e-4361-8c7f-3e863d1827ed tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:26.908354 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e6cc1383-c42e-4361-8c7f-3e863d1827ed tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:26.909149 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e6cc1383-c42e-4361-8c7f-3e863d1827ed tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:26.910207 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e6cc1383-c42e-4361-8c7f-3e863d1827ed tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:27.042263 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-e6cc1383-c42e-4361-8c7f-3e863d1827ed tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:27.049514 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-e6cc1383-c42e-4361-8c7f-3e863d1827ed tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.152020 May 13 17:29:27.050082 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 201/405] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:26 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:27.419815 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6fd4269b-8e89-47a3-accf-dfc7b79ee409 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:27.420421 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6fd4269b-8e89-47a3-accf-dfc7b79ee409 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:27.426184 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6fd4269b-8e89-47a3-accf-dfc7b79ee409 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:27.426633 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6fd4269b-8e89-47a3-accf-dfc7b79ee409 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:27.427422 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6fd4269b-8e89-47a3-accf-dfc7b79ee409 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:27.427861 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6fd4269b-8e89-47a3-accf-dfc7b79ee409 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:27.446349 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f847a6b2-57e6-4181-a790-e968a8b5cd01 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:27.446999 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-f847a6b2-57e6-4181-a790-e968a8b5cd01 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:27.453402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f847a6b2-57e6-4181-a790-e968a8b5cd01 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:27.453857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f847a6b2-57e6-4181-a790-e968a8b5cd01 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:27.454633 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f847a6b2-57e6-4181-a790-e968a8b5cd01 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:27.455079 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f847a6b2-57e6-4181-a790-e968a8b5cd01 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:27.490520 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6fd4269b-8e89-47a3-accf-dfc7b79ee409 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:27.504421 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6fd4269b-8e89-47a3-accf-dfc7b79ee409 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1462 microversion: 2.1 time: 0.088376 May 13 17:29:27.505059 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 205/406] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:27 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1462 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:27.602138 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f847a6b2-57e6-4181-a790-e968a8b5cd01 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:27.609834 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f847a6b2-57e6-4181-a790-e968a8b5cd01 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.167141 May 13 17:29:27.610436 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 202/407] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:27 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:28.066319 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2598e25a-daf2-4cb0-8dc7-b689b77c7b3d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:28.067003 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2598e25a-daf2-4cb0-8dc7-b689b77c7b3d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:28.072896 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2598e25a-daf2-4cb0-8dc7-b689b77c7b3d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:28.073345 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2598e25a-daf2-4cb0-8dc7-b689b77c7b3d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:28.074105 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2598e25a-daf2-4cb0-8dc7-b689b77c7b3d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:28.074541 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2598e25a-daf2-4cb0-8dc7-b689b77c7b3d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:28.220243 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2598e25a-daf2-4cb0-8dc7-b689b77c7b3d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:28.228045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2598e25a-daf2-4cb0-8dc7-b689b77c7b3d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.165574 May 13 17:29:28.228603 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 206/408] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:28 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:28.522004 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-4265f4c1-0e29-42b9-8ecf-b3ffc4dd1d80 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:28.522613 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-4265f4c1-0e29-42b9-8ecf-b3ffc4dd1d80 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:28.528969 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4265f4c1-0e29-42b9-8ecf-b3ffc4dd1d80 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:28.529412 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4265f4c1-0e29-42b9-8ecf-b3ffc4dd1d80 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:28.530175 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4265f4c1-0e29-42b9-8ecf-b3ffc4dd1d80 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:28.530638 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4265f4c1-0e29-42b9-8ecf-b3ffc4dd1d80 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:28.596477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-4265f4c1-0e29-42b9-8ecf-b3ffc4dd1d80 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:28.607182 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-4265f4c1-0e29-42b9-8ecf-b3ffc4dd1d80 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1462 microversion: 2.1 time: 0.088643 May 13 17:29:28.607768 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 203/409] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:28 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1462 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:28.627437 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-004d0f78-bdb2-4acb-8f4c-be01db11acdd tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:28.628049 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-004d0f78-bdb2-4acb-8f4c-be01db11acdd tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:28.633901 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-004d0f78-bdb2-4acb-8f4c-be01db11acdd tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:28.634348 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-004d0f78-bdb2-4acb-8f4c-be01db11acdd tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:28.635098 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-004d0f78-bdb2-4acb-8f4c-be01db11acdd tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:28.635570 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-004d0f78-bdb2-4acb-8f4c-be01db11acdd tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:28.761252 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-004d0f78-bdb2-4acb-8f4c-be01db11acdd tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:28.770291 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-004d0f78-bdb2-4acb-8f4c-be01db11acdd tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.146526 May 13 17:29:28.770873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 207/410] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:28 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:29.245339 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-c5740ca1-a9e1-45d3-98c1-d555f650690a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:29.245874 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-c5740ca1-a9e1-45d3-98c1-d555f650690a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:29.252221 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c5740ca1-a9e1-45d3-98c1-d555f650690a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:29.252681 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c5740ca1-a9e1-45d3-98c1-d555f650690a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:29.253469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c5740ca1-a9e1-45d3-98c1-d555f650690a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:29.254548 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c5740ca1-a9e1-45d3-98c1-d555f650690a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:29.380594 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c5740ca1-a9e1-45d3-98c1-d555f650690a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:29.388031 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-c5740ca1-a9e1-45d3-98c1-d555f650690a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.146675 May 13 17:29:29.388606 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 204/411] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:29 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:29.623932 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2ff7984c-2f97-4192-aa70-10dd0f311f5b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:29.624550 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2ff7984c-2f97-4192-aa70-10dd0f311f5b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:29.630307 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2ff7984c-2f97-4192-aa70-10dd0f311f5b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:29.630844 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2ff7984c-2f97-4192-aa70-10dd0f311f5b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:29.631527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2ff7984c-2f97-4192-aa70-10dd0f311f5b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:29.631967 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2ff7984c-2f97-4192-aa70-10dd0f311f5b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:29.692446 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2ff7984c-2f97-4192-aa70-10dd0f311f5b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:29.699675 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2ff7984c-2f97-4192-aa70-10dd0f311f5b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1462 microversion: 2.1 time: 0.079506 May 13 17:29:29.700238 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 208/412] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:29 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1462 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:29.786931 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a0b5a7d7-9ced-456b-8cd1-c45df6f73cc0 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:29.787568 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a0b5a7d7-9ced-456b-8cd1-c45df6f73cc0 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:29.794031 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a0b5a7d7-9ced-456b-8cd1-c45df6f73cc0 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:29.794571 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a0b5a7d7-9ced-456b-8cd1-c45df6f73cc0 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:29.795384 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a0b5a7d7-9ced-456b-8cd1-c45df6f73cc0 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:29.795828 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a0b5a7d7-9ced-456b-8cd1-c45df6f73cc0 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:29.917842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a0b5a7d7-9ced-456b-8cd1-c45df6f73cc0 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:29.927029 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a0b5a7d7-9ced-456b-8cd1-c45df6f73cc0 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.144515 May 13 17:29:29.927869 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 205/413] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:29 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:30.404659 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-888696c7-836a-4705-bb28-aff5e8a8ce6a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:30.405261 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-888696c7-836a-4705-bb28-aff5e8a8ce6a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:30.411212 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-888696c7-836a-4705-bb28-aff5e8a8ce6a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:30.411661 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-888696c7-836a-4705-bb28-aff5e8a8ce6a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:30.412414 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-888696c7-836a-4705-bb28-aff5e8a8ce6a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:30.412845 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-888696c7-836a-4705-bb28-aff5e8a8ce6a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:30.544682 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-888696c7-836a-4705-bb28-aff5e8a8ce6a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:30.552128 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-888696c7-836a-4705-bb28-aff5e8a8ce6a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.151309 May 13 17:29:30.552688 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 209/414] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:30 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:30.715749 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-944e5f15-d218-4051-bdd2-5e3be731cc68 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:30.716359 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-944e5f15-d218-4051-bdd2-5e3be731cc68 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:30.722430 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-944e5f15-d218-4051-bdd2-5e3be731cc68 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:30.722877 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-944e5f15-d218-4051-bdd2-5e3be731cc68 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:30.723675 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-944e5f15-d218-4051-bdd2-5e3be731cc68 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:30.724115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-944e5f15-d218-4051-bdd2-5e3be731cc68 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:30.786247 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-944e5f15-d218-4051-bdd2-5e3be731cc68 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:30.793530 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-944e5f15-d218-4051-bdd2-5e3be731cc68 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1462 microversion: 2.1 time: 0.081699 May 13 17:29:30.794097 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 206/415] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:30 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1462 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:30.945677 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-df559c5c-9292-4de1-b9d9-58fe1c0eeca3 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:30.946228 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-df559c5c-9292-4de1-b9d9-58fe1c0eeca3 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:30.952134 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-df559c5c-9292-4de1-b9d9-58fe1c0eeca3 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:30.952599 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-df559c5c-9292-4de1-b9d9-58fe1c0eeca3 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:30.953350 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-df559c5c-9292-4de1-b9d9-58fe1c0eeca3 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:30.953816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-df559c5c-9292-4de1-b9d9-58fe1c0eeca3 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:31.077446 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-df559c5c-9292-4de1-b9d9-58fe1c0eeca3 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:31.084575 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-df559c5c-9292-4de1-b9d9-58fe1c0eeca3 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.143348 May 13 17:29:31.085150 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 210/416] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:30 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:31.569013 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-60769711-7373-4ce3-92ed-44cd9ab6c352 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:31.569614 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-60769711-7373-4ce3-92ed-44cd9ab6c352 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:31.575492 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-60769711-7373-4ce3-92ed-44cd9ab6c352 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:31.575937 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-60769711-7373-4ce3-92ed-44cd9ab6c352 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:31.576688 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-60769711-7373-4ce3-92ed-44cd9ab6c352 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:31.577123 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-60769711-7373-4ce3-92ed-44cd9ab6c352 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:31.724377 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-60769711-7373-4ce3-92ed-44cd9ab6c352 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:31.733101 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-60769711-7373-4ce3-92ed-44cd9ab6c352 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.167805 May 13 17:29:31.743274 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 207/417] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:31 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:31.811276 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ede8429a-0755-4ba2-ac9f-c4a8743b8fd5 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:31.811907 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ede8429a-0755-4ba2-ac9f-c4a8743b8fd5 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:31.819274 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ede8429a-0755-4ba2-ac9f-c4a8743b8fd5 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:31.819803 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ede8429a-0755-4ba2-ac9f-c4a8743b8fd5 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:31.820696 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ede8429a-0755-4ba2-ac9f-c4a8743b8fd5 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:31.821139 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ede8429a-0755-4ba2-ac9f-c4a8743b8fd5 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:31.885844 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ede8429a-0755-4ba2-ac9f-c4a8743b8fd5 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:31.895503 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ede8429a-0755-4ba2-ac9f-c4a8743b8fd5 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1462 microversion: 2.1 time: 0.087300 May 13 17:29:31.897115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 211/418] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:31 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1462 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:32.100880 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-2c4bdc78-e00a-4165-9c5c-151b4bd430b8 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:32.101583 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-2c4bdc78-e00a-4165-9c5c-151b4bd430b8 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:32.107480 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2c4bdc78-e00a-4165-9c5c-151b4bd430b8 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:32.107932 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2c4bdc78-e00a-4165-9c5c-151b4bd430b8 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:32.108702 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2c4bdc78-e00a-4165-9c5c-151b4bd430b8 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:32.109136 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2c4bdc78-e00a-4165-9c5c-151b4bd430b8 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:32.260190 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-2c4bdc78-e00a-4165-9c5c-151b4bd430b8 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:32.267599 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-2c4bdc78-e00a-4165-9c5c-151b4bd430b8 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.170579 May 13 17:29:32.268163 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 208/419] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:32 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:32.749500 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-efc95cb0-4ae7-43f2-85eb-88d4b5625aac tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:32.750106 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-efc95cb0-4ae7-43f2-85eb-88d4b5625aac tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:32.755864 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-efc95cb0-4ae7-43f2-85eb-88d4b5625aac tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:32.756315 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-efc95cb0-4ae7-43f2-85eb-88d4b5625aac tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:32.757074 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-efc95cb0-4ae7-43f2-85eb-88d4b5625aac tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:32.757508 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-efc95cb0-4ae7-43f2-85eb-88d4b5625aac tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:32.892715 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-efc95cb0-4ae7-43f2-85eb-88d4b5625aac tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:32.899698 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-efc95cb0-4ae7-43f2-85eb-88d4b5625aac tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.153857 May 13 17:29:32.900422 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 212/420] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:32 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:32.919057 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-61064a33-4ed6-4c0a-983b-ef36cf20377f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:32.921255 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-61064a33-4ed6-4c0a-983b-ef36cf20377f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:32.926875 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-61064a33-4ed6-4c0a-983b-ef36cf20377f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:32.927419 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-61064a33-4ed6-4c0a-983b-ef36cf20377f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:32.928149 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-61064a33-4ed6-4c0a-983b-ef36cf20377f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:32.928587 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-61064a33-4ed6-4c0a-983b-ef36cf20377f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:32.996369 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-61064a33-4ed6-4c0a-983b-ef36cf20377f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:33.003855 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-61064a33-4ed6-4c0a-983b-ef36cf20377f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1462 microversion: 2.1 time: 0.089569 May 13 17:29:33.004419 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 209/421] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:32 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1462 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:33.284640 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-cf4542d5-fcd1-457e-ad45-dbc5e11fd951 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:33.285189 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-cf4542d5-fcd1-457e-ad45-dbc5e11fd951 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:33.291556 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cf4542d5-fcd1-457e-ad45-dbc5e11fd951 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:33.293157 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cf4542d5-fcd1-457e-ad45-dbc5e11fd951 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:33.293157 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cf4542d5-fcd1-457e-ad45-dbc5e11fd951 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:33.293349 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cf4542d5-fcd1-457e-ad45-dbc5e11fd951 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:33.448746 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-cf4542d5-fcd1-457e-ad45-dbc5e11fd951 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:33.456235 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-cf4542d5-fcd1-457e-ad45-dbc5e11fd951 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.175532 May 13 17:29:33.457454 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 213/422] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:33 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:33.633834 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a9b49cf0-807b-481b-9050-124bbb51fcf6 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:33.634413 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a9b49cf0-807b-481b-9050-124bbb51fcf6 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:33.640251 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a9b49cf0-807b-481b-9050-124bbb51fcf6 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:33.640708 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a9b49cf0-807b-481b-9050-124bbb51fcf6 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:33.641479 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a9b49cf0-807b-481b-9050-124bbb51fcf6 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:33.641921 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a9b49cf0-807b-481b-9050-124bbb51fcf6 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:33.663761 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a9b49cf0-807b-481b-9050-124bbb51fcf6 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0/ips" status: 200 len: 151 microversion: 2.1 time: 0.034815 May 13 17:29:33.664330 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 210/423] 10.222.0.64 () {58 vars in 1247 bytes} [Fri May 13 17:29:33 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:29:33.918906 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-00b9b459-e2b9-475a-9405-9edd326fd729 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:33.919545 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-00b9b459-e2b9-475a-9405-9edd326fd729 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:33.926268 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-00b9b459-e2b9-475a-9405-9edd326fd729 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:33.929890 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-00b9b459-e2b9-475a-9405-9edd326fd729 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:33.929890 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-00b9b459-e2b9-475a-9405-9edd326fd729 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:33.929890 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-00b9b459-e2b9-475a-9405-9edd326fd729 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:34.019981 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-0a5f4238-fd86-402b-b899-b7f8c5b54549 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:34.020593 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-0a5f4238-fd86-402b-b899-b7f8c5b54549 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:34.028767 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0a5f4238-fd86-402b-b899-b7f8c5b54549 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:34.029223 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0a5f4238-fd86-402b-b899-b7f8c5b54549 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:34.030004 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0a5f4238-fd86-402b-b899-b7f8c5b54549 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:34.030444 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0a5f4238-fd86-402b-b899-b7f8c5b54549 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:34.061716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-00b9b459-e2b9-475a-9405-9edd326fd729 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:34.069375 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-00b9b459-e2b9-475a-9405-9edd326fd729 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.154305 May 13 17:29:34.070219 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 214/424] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:33 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:34.091678 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0a5f4238-fd86-402b-b899-b7f8c5b54549 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:34.099666 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-0a5f4238-fd86-402b-b899-b7f8c5b54549 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1462 microversion: 2.1 time: 0.083506 May 13 17:29:34.100244 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 211/425] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:34 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1462 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:34.481511 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-41cfbf81-db5a-41f3-b282-403b6a47e87d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:34.482172 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-41cfbf81-db5a-41f3-b282-403b6a47e87d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:34.488227 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-41cfbf81-db5a-41f3-b282-403b6a47e87d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:34.488692 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-41cfbf81-db5a-41f3-b282-403b6a47e87d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:34.489445 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-41cfbf81-db5a-41f3-b282-403b6a47e87d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:34.489877 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-41cfbf81-db5a-41f3-b282-403b6a47e87d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:34.616371 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-41cfbf81-db5a-41f3-b282-403b6a47e87d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:34.624185 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-41cfbf81-db5a-41f3-b282-403b6a47e87d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.146506 May 13 17:29:34.630098 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 215/426] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:34 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:35.091467 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3d7707c8-57e2-4e8c-9ca8-4846966c3fc5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:35.094182 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3d7707c8-57e2-4e8c-9ca8-4846966c3fc5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:35.103395 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3d7707c8-57e2-4e8c-9ca8-4846966c3fc5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:35.103851 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3d7707c8-57e2-4e8c-9ca8-4846966c3fc5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:35.104649 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3d7707c8-57e2-4e8c-9ca8-4846966c3fc5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:35.105091 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3d7707c8-57e2-4e8c-9ca8-4846966c3fc5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:35.120756 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-194ca982-e27c-44dc-b105-560bbf73da18 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:35.122102 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-194ca982-e27c-44dc-b105-560bbf73da18 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:35.128221 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-194ca982-e27c-44dc-b105-560bbf73da18 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:35.129374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-194ca982-e27c-44dc-b105-560bbf73da18 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:35.130235 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-194ca982-e27c-44dc-b105-560bbf73da18 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:35.130750 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-194ca982-e27c-44dc-b105-560bbf73da18 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:35.228128 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-194ca982-e27c-44dc-b105-560bbf73da18 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:35.236304 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-194ca982-e27c-44dc-b105-560bbf73da18 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1462 microversion: 2.1 time: 0.119936 May 13 17:29:35.248211 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 216/427] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:35 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1462 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:35.253445 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3d7707c8-57e2-4e8c-9ca8-4846966c3fc5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:35.263291 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3d7707c8-57e2-4e8c-9ca8-4846966c3fc5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.180315 May 13 17:29:35.263867 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 212/428] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:35 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:35.641166 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7332d2d1-0bcf-494a-9ca1-ce6b26cc3756 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:35.642226 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7332d2d1-0bcf-494a-9ca1-ce6b26cc3756 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:35.648820 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7332d2d1-0bcf-494a-9ca1-ce6b26cc3756 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:35.649602 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7332d2d1-0bcf-494a-9ca1-ce6b26cc3756 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:35.650652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7332d2d1-0bcf-494a-9ca1-ce6b26cc3756 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:35.651336 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7332d2d1-0bcf-494a-9ca1-ce6b26cc3756 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:35.786672 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7332d2d1-0bcf-494a-9ca1-ce6b26cc3756 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:35.793807 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7332d2d1-0bcf-494a-9ca1-ce6b26cc3756 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.156877 May 13 17:29:35.794386 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 217/429] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:35 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:36.254855 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-bf9b4545-c7a2-474f-8f38-9ca2e6e93f7f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:36.255525 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-bf9b4545-c7a2-474f-8f38-9ca2e6e93f7f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:36.261854 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bf9b4545-c7a2-474f-8f38-9ca2e6e93f7f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:36.262277 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bf9b4545-c7a2-474f-8f38-9ca2e6e93f7f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:36.263032 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bf9b4545-c7a2-474f-8f38-9ca2e6e93f7f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:36.263489 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bf9b4545-c7a2-474f-8f38-9ca2e6e93f7f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:36.281246 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e9a2cb0d-d87f-4fbd-a4a1-2566519c09ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:36.281949 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e9a2cb0d-d87f-4fbd-a4a1-2566519c09ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:36.288158 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e9a2cb0d-d87f-4fbd-a4a1-2566519c09ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:36.288888 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e9a2cb0d-d87f-4fbd-a4a1-2566519c09ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:36.289669 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e9a2cb0d-d87f-4fbd-a4a1-2566519c09ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:36.290108 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e9a2cb0d-d87f-4fbd-a4a1-2566519c09ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:36.326415 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-bf9b4545-c7a2-474f-8f38-9ca2e6e93f7f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:36.334508 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-bf9b4545-c7a2-474f-8f38-9ca2e6e93f7f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1462 microversion: 2.1 time: 0.084165 May 13 17:29:36.335088 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 213/430] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:36 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1462 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:36.417119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e9a2cb0d-d87f-4fbd-a4a1-2566519c09ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:36.424344 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e9a2cb0d-d87f-4fbd-a4a1-2566519c09ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.146940 May 13 17:29:36.424905 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 218/431] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:36 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:36.810748 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-72a937e4-b58f-441f-bc11-d9de3d570474 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:36.811384 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-72a937e4-b58f-441f-bc11-d9de3d570474 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:36.817896 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-72a937e4-b58f-441f-bc11-d9de3d570474 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:36.818337 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-72a937e4-b58f-441f-bc11-d9de3d570474 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:36.819100 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-72a937e4-b58f-441f-bc11-d9de3d570474 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:36.819556 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-72a937e4-b58f-441f-bc11-d9de3d570474 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:36.948496 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-72a937e4-b58f-441f-bc11-d9de3d570474 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:36.955668 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-72a937e4-b58f-441f-bc11-d9de3d570474 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.148707 May 13 17:29:36.956232 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 214/432] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:36 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:37.351743 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a823fa75-b75b-4521-a119-c795dd410b5a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:37.352304 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a823fa75-b75b-4521-a119-c795dd410b5a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:37.358139 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a823fa75-b75b-4521-a119-c795dd410b5a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:37.358583 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a823fa75-b75b-4521-a119-c795dd410b5a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:37.359365 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a823fa75-b75b-4521-a119-c795dd410b5a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:37.359805 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a823fa75-b75b-4521-a119-c795dd410b5a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:37.422608 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a823fa75-b75b-4521-a119-c795dd410b5a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:37.431110 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a823fa75-b75b-4521-a119-c795dd410b5a tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1462 microversion: 2.1 time: 0.083758 May 13 17:29:37.431615 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 219/433] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:37 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1462 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:37.444199 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-93621360-658b-4303-8bf2-eabd83005703 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:37.444981 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-93621360-658b-4303-8bf2-eabd83005703 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:37.452095 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-93621360-658b-4303-8bf2-eabd83005703 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:37.452553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-93621360-658b-4303-8bf2-eabd83005703 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:37.453513 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-93621360-658b-4303-8bf2-eabd83005703 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:37.453958 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-93621360-658b-4303-8bf2-eabd83005703 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:37.589335 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-93621360-658b-4303-8bf2-eabd83005703 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:37.596779 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-93621360-658b-4303-8bf2-eabd83005703 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.157044 May 13 17:29:37.597922 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 215/434] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:37 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:37.972771 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d86abdf4-65b8-4783-9a32-85ff0411397b tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:37.973384 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d86abdf4-65b8-4783-9a32-85ff0411397b tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:37.979354 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d86abdf4-65b8-4783-9a32-85ff0411397b tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:37.979808 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d86abdf4-65b8-4783-9a32-85ff0411397b tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:37.980576 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d86abdf4-65b8-4783-9a32-85ff0411397b tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:37.981018 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d86abdf4-65b8-4783-9a32-85ff0411397b tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:38.123012 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d86abdf4-65b8-4783-9a32-85ff0411397b tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:38.131692 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d86abdf4-65b8-4783-9a32-85ff0411397b tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.163086 May 13 17:29:38.141391 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 220/435] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:37 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:38.448080 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-0af64cc8-b782-4605-9586-d8903d3fa8ff tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:38.448708 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-0af64cc8-b782-4605-9586-d8903d3fa8ff tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:38.455004 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0af64cc8-b782-4605-9586-d8903d3fa8ff tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:38.455487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0af64cc8-b782-4605-9586-d8903d3fa8ff tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:38.456255 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0af64cc8-b782-4605-9586-d8903d3fa8ff tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:38.456690 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0af64cc8-b782-4605-9586-d8903d3fa8ff tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:38.493465 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-985b0fd1-66e6-4a86-8e37-df4ef9c08d15 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ab332c2-36c5-4d07-8b2e-de0f508138b2"}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:29:38.494604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-985b0fd1-66e6-4a86-8e37-df4ef9c08d15 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:38.500784 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-985b0fd1-66e6-4a86-8e37-df4ef9c08d15 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:38.501232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-985b0fd1-66e6-4a86-8e37-df4ef9c08d15 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:38.502005 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-985b0fd1-66e6-4a86-8e37-df4ef9c08d15 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:38.502447 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-985b0fd1-66e6-4a86-8e37-df4ef9c08d15 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:38.518829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0af64cc8-b782-4605-9586-d8903d3fa8ff tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:38.526172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-0af64cc8-b782-4605-9586-d8903d3fa8ff tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1462 microversion: 2.1 time: 0.081821 May 13 17:29:38.526747 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 216/436] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:38 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1462 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:38.614541 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-811a026b-759f-45fe-a420-8fe13ebdef45 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:38.614702 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-811a026b-759f-45fe-a420-8fe13ebdef45 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:38.620602 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-811a026b-759f-45fe-a420-8fe13ebdef45 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:38.621044 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-811a026b-759f-45fe-a420-8fe13ebdef45 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:38.621805 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-811a026b-759f-45fe-a420-8fe13ebdef45 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:38.622233 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-811a026b-759f-45fe-a420-8fe13ebdef45 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:38.754100 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-811a026b-759f-45fe-a420-8fe13ebdef45 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:38.761440 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-811a026b-759f-45fe-a420-8fe13ebdef45 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.151745 May 13 17:29:38.762007 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 217/437] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:38 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:39.149386 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b5b51fa8-1cff-4810-b295-ae7f24b8dd4e tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:39.149995 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b5b51fa8-1cff-4810-b295-ae7f24b8dd4e tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:39.155770 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b5b51fa8-1cff-4810-b295-ae7f24b8dd4e tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:39.156216 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b5b51fa8-1cff-4810-b295-ae7f24b8dd4e tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:39.156978 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b5b51fa8-1cff-4810-b295-ae7f24b8dd4e tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:39.157413 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b5b51fa8-1cff-4810-b295-ae7f24b8dd4e tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:39.282406 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b5b51fa8-1cff-4810-b295-ae7f24b8dd4e tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:39.289544 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b5b51fa8-1cff-4810-b295-ae7f24b8dd4e tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.143977 May 13 17:29:39.290114 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 218/438] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:39 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:39.544080 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-76184a8f-b8ab-4abe-9205-c5f46e41b223 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:39.544624 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-76184a8f-b8ab-4abe-9205-c5f46e41b223 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:39.551436 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-76184a8f-b8ab-4abe-9205-c5f46e41b223 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:39.551888 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-76184a8f-b8ab-4abe-9205-c5f46e41b223 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:39.552666 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-76184a8f-b8ab-4abe-9205-c5f46e41b223 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:39.553105 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-76184a8f-b8ab-4abe-9205-c5f46e41b223 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:39.617805 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-76184a8f-b8ab-4abe-9205-c5f46e41b223 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:39.625243 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-76184a8f-b8ab-4abe-9205-c5f46e41b223 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1462 microversion: 2.1 time: 0.085076 May 13 17:29:39.625813 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 219/439] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:39 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1462 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:39.777588 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-aa9e7c24-be42-466b-af5b-41cc42e980a8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:39.778197 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-aa9e7c24-be42-466b-af5b-41cc42e980a8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:39.784074 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-aa9e7c24-be42-466b-af5b-41cc42e980a8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:39.784526 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-aa9e7c24-be42-466b-af5b-41cc42e980a8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:39.785962 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-aa9e7c24-be42-466b-af5b-41cc42e980a8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:39.786407 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-aa9e7c24-be42-466b-af5b-41cc42e980a8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:39.919499 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-aa9e7c24-be42-466b-af5b-41cc42e980a8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:39.926869 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-aa9e7c24-be42-466b-af5b-41cc42e980a8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.153084 May 13 17:29:39.939666 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 220/440] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:39 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:40.305768 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-8bd1d1eb-340b-4abe-b887-cf15d3d35726 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:40.306374 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-8bd1d1eb-340b-4abe-b887-cf15d3d35726 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:40.312161 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8bd1d1eb-340b-4abe-b887-cf15d3d35726 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:40.312616 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8bd1d1eb-340b-4abe-b887-cf15d3d35726 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:40.313375 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8bd1d1eb-340b-4abe-b887-cf15d3d35726 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:40.313810 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8bd1d1eb-340b-4abe-b887-cf15d3d35726 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:40.442121 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-8bd1d1eb-340b-4abe-b887-cf15d3d35726 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:40.449677 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-8bd1d1eb-340b-4abe-b887-cf15d3d35726 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.147712 May 13 17:29:40.450335 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 221/441] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:40 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:40.642373 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-e2ca8f22-1516-4bea-8944-5dac6807a98e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:40.643028 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-e2ca8f22-1516-4bea-8944-5dac6807a98e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:40.652730 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e2ca8f22-1516-4bea-8944-5dac6807a98e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:40.655859 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e2ca8f22-1516-4bea-8944-5dac6807a98e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:40.656890 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e2ca8f22-1516-4bea-8944-5dac6807a98e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:40.657425 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e2ca8f22-1516-4bea-8944-5dac6807a98e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:40.692730 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e2ca8f22-1516-4bea-8944-5dac6807a98e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:40.693346 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e2ca8f22-1516-4bea-8944-5dac6807a98e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:40.693860 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.objects.instance [None req-e2ca8f22-1516-4bea-8944-5dac6807a98e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lazy-loading 'fault' on Instance uuid bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc {{(pid=117492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:29:40.744155 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-e2ca8f22-1516-4bea-8944-5dac6807a98e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:40.752407 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-e2ca8f22-1516-4bea-8944-5dac6807a98e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1304 microversion: 2.1 time: 0.114301 May 13 17:29:40.754052 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 222/442] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:40 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:40.903504 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-c1fdc9c6-7779-4369-bc59-e353fd6b4d84 req-e077fe56-0464-4bce-a47e-b48701e53c5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d07e598b-0481-4f7e-9957-49cd7dbbac98", "tag": "53b14020-f762-46c1-859f-588cb62cbd07"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:29:40.915434 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-c1fdc9c6-7779-4369-bc59-e353fd6b4d84 req-e077fe56-0464-4bce-a47e-b48701e53c5a service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:40.915889 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-c1fdc9c6-7779-4369-bc59-e353fd6b4d84 req-e077fe56-0464-4bce-a47e-b48701e53c5a service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:40.933057 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-c1fdc9c6-7779-4369-bc59-e353fd6b4d84 req-e077fe56-0464-4bce-a47e-b48701e53c5a service nova] Creating event network-changed:53b14020-f762-46c1-859f-588cb62cbd07 for instance d07e598b-0481-4f7e-9957-49cd7dbbac98 on hv-cinder-84178 May 13 17:29:40.933057 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-c1fdc9c6-7779-4369-bc59-e353fd6b4d84 req-e077fe56-0464-4bce-a47e-b48701e53c5a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032549 May 13 17:29:40.933057 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 223/443] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:29:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:29:40.944034 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-99096366-e839-40c2-a2b8-ff52901a8075 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:40.944734 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-99096366-e839-40c2-a2b8-ff52901a8075 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:40.951190 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-99096366-e839-40c2-a2b8-ff52901a8075 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:40.951665 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-99096366-e839-40c2-a2b8-ff52901a8075 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:40.952448 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-99096366-e839-40c2-a2b8-ff52901a8075 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:40.952897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-99096366-e839-40c2-a2b8-ff52901a8075 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:41.116302 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-99096366-e839-40c2-a2b8-ff52901a8075 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:41.124041 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-99096366-e839-40c2-a2b8-ff52901a8075 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.184190 May 13 17:29:41.124632 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 224/444] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:40 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:41.263423 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-985b0fd1-66e6-4a86-8e37-df4ef9c08d15 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "POST /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.773428 May 13 17:29:41.263955 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 221/445] 10.222.0.64 () {60 vars in 1322 bytes} [Fri May 13 17:29:38 2022] POST /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0/os-volume_attachments => generated 194 bytes in 2775 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:29:41.472998 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f8479c55-46fb-440f-b4af-1ac9f7eac6a2 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:41.473992 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-f8479c55-46fb-440f-b4af-1ac9f7eac6a2 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:41.484195 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f8479c55-46fb-440f-b4af-1ac9f7eac6a2 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:41.484646 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f8479c55-46fb-440f-b4af-1ac9f7eac6a2 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:41.485500 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f8479c55-46fb-440f-b4af-1ac9f7eac6a2 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:41.485999 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f8479c55-46fb-440f-b4af-1ac9f7eac6a2 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:41.625827 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f8479c55-46fb-440f-b4af-1ac9f7eac6a2 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:41.633502 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f8479c55-46fb-440f-b4af-1ac9f7eac6a2 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.165171 May 13 17:29:41.637189 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 225/446] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:41 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:41.772159 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-03342efb-9d5d-4d50-95ab-1eee26835c51 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:41.772813 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-03342efb-9d5d-4d50-95ab-1eee26835c51 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:41.779290 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-03342efb-9d5d-4d50-95ab-1eee26835c51 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:41.783664 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-03342efb-9d5d-4d50-95ab-1eee26835c51 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:41.783664 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-03342efb-9d5d-4d50-95ab-1eee26835c51 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:41.783664 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-03342efb-9d5d-4d50-95ab-1eee26835c51 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:41.809531 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-03342efb-9d5d-4d50-95ab-1eee26835c51 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:41.809979 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-03342efb-9d5d-4d50-95ab-1eee26835c51 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:41.810424 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-03342efb-9d5d-4d50-95ab-1eee26835c51 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lazy-loading 'fault' on Instance uuid bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:29:41.854104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-03342efb-9d5d-4d50-95ab-1eee26835c51 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:41.861343 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-03342efb-9d5d-4d50-95ab-1eee26835c51 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 200 len: 1304 microversion: 2.1 time: 0.094879 May 13 17:29:41.861910 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 222/447] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:41 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:42.141536 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-9c8e476a-6c0b-4eec-8611-0d92da38cc78 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:42.142148 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-9c8e476a-6c0b-4eec-8611-0d92da38cc78 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:42.148918 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9c8e476a-6c0b-4eec-8611-0d92da38cc78 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:42.149497 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9c8e476a-6c0b-4eec-8611-0d92da38cc78 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:42.150378 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9c8e476a-6c0b-4eec-8611-0d92da38cc78 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:42.150903 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9c8e476a-6c0b-4eec-8611-0d92da38cc78 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:42.295804 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-9c8e476a-6c0b-4eec-8611-0d92da38cc78 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:42.303845 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-9c8e476a-6c0b-4eec-8611-0d92da38cc78 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.166524 May 13 17:29:42.304365 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 226/448] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:42 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:42.650235 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-11c0a699-0896-47f1-860e-c012d7c28fc9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:42.650841 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-11c0a699-0896-47f1-860e-c012d7c28fc9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:42.656729 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-11c0a699-0896-47f1-860e-c012d7c28fc9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:42.657220 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-11c0a699-0896-47f1-860e-c012d7c28fc9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:42.657981 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-11c0a699-0896-47f1-860e-c012d7c28fc9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:42.658417 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-11c0a699-0896-47f1-860e-c012d7c28fc9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:42.784067 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-11c0a699-0896-47f1-860e-c012d7c28fc9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:42.792042 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-11c0a699-0896-47f1-860e-c012d7c28fc9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.145693 May 13 17:29:42.795232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 223/449] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:42 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:42.878863 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-533622a0-a3f2-4099-9f1e-8860ec5ea5ee tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:42.879523 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-533622a0-a3f2-4099-9f1e-8860ec5ea5ee tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:42.885441 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-533622a0-a3f2-4099-9f1e-8860ec5ea5ee tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:42.885873 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-533622a0-a3f2-4099-9f1e-8860ec5ea5ee tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:42.886636 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-533622a0-a3f2-4099-9f1e-8860ec5ea5ee tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:42.887121 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-533622a0-a3f2-4099-9f1e-8860ec5ea5ee tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:42.900765 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-533622a0-a3f2-4099-9f1e-8860ec5ea5ee tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] HTTP exception thrown: Instance bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc could not be found. May 13 17:29:42.902773 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-533622a0-a3f2-4099-9f1e-8860ec5ea5ee tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Request method failure captured: May 13 17:29:42.902773 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc HTTP/1.1 May 13 17:29:42.902773 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:29:42.902773 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:29:42.902773 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:29:42.902773 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 0 May 13 17:29:42.902773 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:29:42.902773 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:29:42.902773 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:29:42.902773 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:29:42.902773 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpVBrsbKPZ8RQNxMH74iUtK-jL9mi-NBuUi3AqZrnArpUgy2OeVvMGQoP5eSDkjKfD3_ex7KlOoFe8sS-wKNEduHvvhajzCqFS8opel6XHF52qwV9QSY_OGsPnV51GoYkZgjmmDhOMhU0ShLX9Nrtl2icpv-0gSIaEUD-WWCgU75KgQ May 13 17:29:42.902773 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:29:42.902773 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:29:42.902773 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:29:42.902773 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:29:42.902773 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:29:42.902773 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:29:42.902773 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: f6fceef0782240ccb486341a9007e4b0 May 13 17:29:42.902773 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-VolumesActionsTest-1369299399 May 13 17:29:42.902773 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:29:42.902773 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:29:42.904402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f6fceef0782240ccb486341a9007e4b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f6fceef0782240ccb486341a9007e4b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f6fceef0782240ccb486341a9007e4b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f6fceef0782240ccb486341a9007e4b0"}]}] May 13 17:29:42.904402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-VolumesActionsTest-1369299399 May 13 17:29:42.904402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: f6fceef0782240ccb486341a9007e4b0 May 13 17:29:42.904402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-VolumesActionsTest-1369299399 May 13 17:29:42.904402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-VolumesActionsTest-1369299399-project May 13 17:29:42.904402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:29:42.904402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:29:42.904402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: e7d764501bed41d99941c6e083e19482 May 13 17:29:42.904402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-VolumesActionsTest-1369299399-project May 13 17:29:42.904402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: > May 13 17:29:42.904402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Instance bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc could not be found. May 13 17:29:42.904402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'id': 'bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc'} May 13 17:29:42.905511 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:29:42.905511 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:29:42.905511 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:29:42.905511 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:29:42.905511 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:29:42.905511 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:29:42.905511 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:29:42.905511 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:29:42.905511 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:29:42.905511 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:29:42.905511 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc could not be found. May 13 17:29:42.905511 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:29:42.905511 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:29:42.905511 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:29:42.905511 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:29:42.905511 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:29:42.905511 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:29:42.905511 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:29:42.905511 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:29:42.905511 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:29:42.906962 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:29:42.906962 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:29:42.906962 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:29:42.906962 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:29:42.906962 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:29:42.906962 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:29:42.906962 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:29:42.906962 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc could not be found. May 13 17:29:42.906962 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:29:42.906962 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:29:42.906962 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:29:42.906962 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:29:42.906962 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:29:42.906962 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:29:42.906962 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:29:42.906962 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:29:42.906962 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc could not be found. May 13 17:29:42.906962 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:29:42.908217 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-533622a0-a3f2-4099-9f1e-8860ec5ea5ee tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Returning 404 to user: Instance bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc could not be found. {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:29:42.908217 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-533622a0-a3f2-4099-9f1e-8860ec5ea5ee tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc" status: 404 len: 111 microversion: 2.1 time: 0.028805 May 13 17:29:42.908217 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 227/450] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:42 2022] GET /compute/v2.1/servers/bf00159b-f3a0-4aaf-a1a2-281c8ab35dbc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:29:43.006248 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-987c9bb4-56f9-4cba-96e9-3d2acc4e216f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1628566899", "imageRef": "7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88", "flavorRef": "452", "networks": [{"uuid": "0a5f1f56-1292-4f48-b919-1c7423ffdedd"}]}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:29:43.057053 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.network.neutron [None req-987c9bb4-56f9-4cba-96e9-3d2acc4e216f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] validate_networks() for [('0a5f1f56-1292-4f48-b919-1c7423ffdedd', None, None, None, None, None)] {{(pid=117493) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 17:29:43.320494 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6653f319-b9c1-4e53-8b37-75134bf2b772 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:43.321111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6653f319-b9c1-4e53-8b37-75134bf2b772 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:43.327437 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6653f319-b9c1-4e53-8b37-75134bf2b772 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:43.327894 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6653f319-b9c1-4e53-8b37-75134bf2b772 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:43.328682 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6653f319-b9c1-4e53-8b37-75134bf2b772 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:43.329122 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6653f319-b9c1-4e53-8b37-75134bf2b772 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:43.402024 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-987c9bb4-56f9-4cba-96e9-3d2acc4e216f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Flavor limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 17:29:43.402804 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-987c9bb4-56f9-4cba-96e9-3d2acc4e216f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Image limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 17:29:43.403480 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-987c9bb4-56f9-4cba-96e9-3d2acc4e216f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Flavor pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 17:29:43.403897 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-987c9bb4-56f9-4cba-96e9-3d2acc4e216f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Image pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 17:29:43.404308 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-987c9bb4-56f9-4cba-96e9-3d2acc4e216f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 17:29:43.414532 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-987c9bb4-56f9-4cba-96e9-3d2acc4e216f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:43.415304 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-987c9bb4-56f9-4cba-96e9-3d2acc4e216f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:43.416945 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-987c9bb4-56f9-4cba-96e9-3d2acc4e216f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:43.429844 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-987c9bb4-56f9-4cba-96e9-3d2acc4e216f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:43.453619 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-987c9bb4-56f9-4cba-96e9-3d2acc4e216f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Getting quotas for project f6fceef0782240ccb486341a9007e4b0. Resources: {'ram', 'instances', 'cores'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:29:43.457796 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-987c9bb4-56f9-4cba-96e9-3d2acc4e216f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Getting quotas for user e7d764501bed41d99941c6e083e19482 and project f6fceef0782240ccb486341a9007e4b0. Resources: {'ram', 'instances', 'cores'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:29:43.469611 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-987c9bb4-56f9-4cba-96e9-3d2acc4e216f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Going to run 1 instances... {{(pid=117493) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 17:29:43.472391 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-987c9bb4-56f9-4cba-96e9-3d2acc4e216f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 17:29:43.486365 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6653f319-b9c1-4e53-8b37-75134bf2b772 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:43.501262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6653f319-b9c1-4e53-8b37-75134bf2b772 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.185065 May 13 17:29:43.589291 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 228/451] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:43 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:43.809033 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-ff3fb4f7-75b7-46b7-a89e-d4aa0b881523 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:43.809563 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-ff3fb4f7-75b7-46b7-a89e-d4aa0b881523 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:43.815560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ff3fb4f7-75b7-46b7-a89e-d4aa0b881523 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:43.816157 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ff3fb4f7-75b7-46b7-a89e-d4aa0b881523 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:43.816952 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ff3fb4f7-75b7-46b7-a89e-d4aa0b881523 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:43.817393 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ff3fb4f7-75b7-46b7-a89e-d4aa0b881523 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:43.977614 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-ff3fb4f7-75b7-46b7-a89e-d4aa0b881523 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:43.985118 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-ff3fb4f7-75b7-46b7-a89e-d4aa0b881523 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.179972 May 13 17:29:43.985753 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 229/452] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:43 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:44.152596 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-987c9bb4-56f9-4cba-96e9-3d2acc4e216f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.150592 May 13 17:29:44.156431 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 224/453] 10.222.0.64 () {60 vars in 1146 bytes} [Fri May 13 17:29:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1152 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 17:29:44.163718 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-196bf5e3-3648-4e86-8fbf-96d9eaa8446e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:44.164322 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-196bf5e3-3648-4e86-8fbf-96d9eaa8446e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:44.219649 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-196bf5e3-3648-4e86-8fbf-96d9eaa8446e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:44.229506 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-196bf5e3-3648-4e86-8fbf-96d9eaa8446e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1214 microversion: 2.1 time: 0.070124 May 13 17:29:44.230228 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 230/454] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:44 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:44.551939 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-43b6ec5b-49b7-4fc9-aa17-fe40b0e8caa6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:44.552642 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-43b6ec5b-49b7-4fc9-aa17-fe40b0e8caa6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:44.558724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-43b6ec5b-49b7-4fc9-aa17-fe40b0e8caa6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:44.559206 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-43b6ec5b-49b7-4fc9-aa17-fe40b0e8caa6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:44.560109 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-43b6ec5b-49b7-4fc9-aa17-fe40b0e8caa6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:44.560549 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-43b6ec5b-49b7-4fc9-aa17-fe40b0e8caa6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:44.689570 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-43b6ec5b-49b7-4fc9-aa17-fe40b0e8caa6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:44.697433 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-43b6ec5b-49b7-4fc9-aa17-fe40b0e8caa6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.149586 May 13 17:29:44.698003 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 225/455] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:44 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:45.001730 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-190b592c-59ee-4c46-a429-18ca9d24fbf5 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:45.002343 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-190b592c-59ee-4c46-a429-18ca9d24fbf5 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:45.010090 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-190b592c-59ee-4c46-a429-18ca9d24fbf5 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:45.010543 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-190b592c-59ee-4c46-a429-18ca9d24fbf5 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:45.011364 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-190b592c-59ee-4c46-a429-18ca9d24fbf5 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:45.011807 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-190b592c-59ee-4c46-a429-18ca9d24fbf5 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:45.135308 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-190b592c-59ee-4c46-a429-18ca9d24fbf5 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:45.142534 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-190b592c-59ee-4c46-a429-18ca9d24fbf5 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.144633 May 13 17:29:45.143104 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 231/456] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:44 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:45.245582 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9248b901-d71d-44ce-af98-39f900903370 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:45.246124 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9248b901-d71d-44ce-af98-39f900903370 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:45.252444 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9248b901-d71d-44ce-af98-39f900903370 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:45.252880 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9248b901-d71d-44ce-af98-39f900903370 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:45.253742 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9248b901-d71d-44ce-af98-39f900903370 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:45.254175 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9248b901-d71d-44ce-af98-39f900903370 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:45.317840 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9248b901-d71d-44ce-af98-39f900903370 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:45.325037 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9248b901-d71d-44ce-af98-39f900903370 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1218 microversion: 2.1 time: 0.083253 May 13 17:29:45.325595 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 226/457] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:45 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:45.713799 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-68ede25e-a36d-4968-a2dd-03792c557f81 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:45.714129 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-68ede25e-a36d-4968-a2dd-03792c557f81 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:45.720105 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-68ede25e-a36d-4968-a2dd-03792c557f81 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:45.720815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-68ede25e-a36d-4968-a2dd-03792c557f81 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:45.721576 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-68ede25e-a36d-4968-a2dd-03792c557f81 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:45.722006 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-68ede25e-a36d-4968-a2dd-03792c557f81 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:45.850330 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-68ede25e-a36d-4968-a2dd-03792c557f81 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:45.857535 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-68ede25e-a36d-4968-a2dd-03792c557f81 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.147823 May 13 17:29:45.858103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 232/458] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:45 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:46.159074 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-23c8d927-c815-48e8-81bd-6fc865dc0031 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:46.160251 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-23c8d927-c815-48e8-81bd-6fc865dc0031 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:46.166768 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-23c8d927-c815-48e8-81bd-6fc865dc0031 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:46.167327 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-23c8d927-c815-48e8-81bd-6fc865dc0031 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:46.169419 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-23c8d927-c815-48e8-81bd-6fc865dc0031 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:46.169419 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-23c8d927-c815-48e8-81bd-6fc865dc0031 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:46.296128 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-23c8d927-c815-48e8-81bd-6fc865dc0031 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:46.308448 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-23c8d927-c815-48e8-81bd-6fc865dc0031 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.153225 May 13 17:29:46.309055 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 227/459] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:46 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:46.341794 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-75ef5ab0-ac0f-49ee-af26-404d1ae333ae tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:46.346886 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-75ef5ab0-ac0f-49ee-af26-404d1ae333ae tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:46.350400 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-75ef5ab0-ac0f-49ee-af26-404d1ae333ae tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:46.350932 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-75ef5ab0-ac0f-49ee-af26-404d1ae333ae tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:46.351746 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-75ef5ab0-ac0f-49ee-af26-404d1ae333ae tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:46.352181 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-75ef5ab0-ac0f-49ee-af26-404d1ae333ae tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:46.412031 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-75ef5ab0-ac0f-49ee-af26-404d1ae333ae tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:46.419193 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-75ef5ab0-ac0f-49ee-af26-404d1ae333ae tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1218 microversion: 2.1 time: 0.081296 May 13 17:29:46.424305 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 233/460] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:46 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:46.875085 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-abf878d0-b500-4ac8-9509-5ef612cb8521 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:46.875726 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-abf878d0-b500-4ac8-9509-5ef612cb8521 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:46.882126 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-abf878d0-b500-4ac8-9509-5ef612cb8521 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:46.882579 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-abf878d0-b500-4ac8-9509-5ef612cb8521 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:46.883386 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-abf878d0-b500-4ac8-9509-5ef612cb8521 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:46.883825 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-abf878d0-b500-4ac8-9509-5ef612cb8521 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:47.015364 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-abf878d0-b500-4ac8-9509-5ef612cb8521 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:47.023204 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-abf878d0-b500-4ac8-9509-5ef612cb8521 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.151881 May 13 17:29:47.023779 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 228/461] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:46 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:47.325470 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-892b6da1-2d53-49e7-bdb9-6c989c198a3e tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:47.326135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-892b6da1-2d53-49e7-bdb9-6c989c198a3e tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:47.332227 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-892b6da1-2d53-49e7-bdb9-6c989c198a3e tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:47.332678 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-892b6da1-2d53-49e7-bdb9-6c989c198a3e tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:47.333477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-892b6da1-2d53-49e7-bdb9-6c989c198a3e tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:47.333915 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-892b6da1-2d53-49e7-bdb9-6c989c198a3e tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:47.435664 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-db51a82f-3c17-4318-865e-b86fab7e4b8e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:47.436275 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-db51a82f-3c17-4318-865e-b86fab7e4b8e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:47.443119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-db51a82f-3c17-4318-865e-b86fab7e4b8e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:47.443775 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-db51a82f-3c17-4318-865e-b86fab7e4b8e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:47.444645 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-db51a82f-3c17-4318-865e-b86fab7e4b8e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:47.445320 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-db51a82f-3c17-4318-865e-b86fab7e4b8e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:47.488583 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-892b6da1-2d53-49e7-bdb9-6c989c198a3e tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:47.500047 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-892b6da1-2d53-49e7-bdb9-6c989c198a3e tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.178262 May 13 17:29:47.500628 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 234/462] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:47 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:47.534259 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-db51a82f-3c17-4318-865e-b86fab7e4b8e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:47.543374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-db51a82f-3c17-4318-865e-b86fab7e4b8e tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1218 microversion: 2.1 time: 0.112169 May 13 17:29:47.543941 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 229/463] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:47 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:48.041545 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-e489a192-ebdc-4a89-b552-0aaba0e9edb6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:48.042370 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-e489a192-ebdc-4a89-b552-0aaba0e9edb6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:48.049529 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e489a192-ebdc-4a89-b552-0aaba0e9edb6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:48.050846 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e489a192-ebdc-4a89-b552-0aaba0e9edb6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:48.051835 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e489a192-ebdc-4a89-b552-0aaba0e9edb6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:48.052429 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e489a192-ebdc-4a89-b552-0aaba0e9edb6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:48.244386 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-e489a192-ebdc-4a89-b552-0aaba0e9edb6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:48.251891 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-e489a192-ebdc-4a89-b552-0aaba0e9edb6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.215213 May 13 17:29:48.252600 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 235/464] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:48 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:48.517755 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-43c07faa-8ce2-4a36-94b1-c29b324e1318 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:48.518385 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-43c07faa-8ce2-4a36-94b1-c29b324e1318 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:48.524875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-43c07faa-8ce2-4a36-94b1-c29b324e1318 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:48.525420 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-43c07faa-8ce2-4a36-94b1-c29b324e1318 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:48.526178 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-43c07faa-8ce2-4a36-94b1-c29b324e1318 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:48.526610 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-43c07faa-8ce2-4a36-94b1-c29b324e1318 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:48.563476 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-48d2ddb0-aef7-4922-a526-14188f261c25 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:48.564804 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-48d2ddb0-aef7-4922-a526-14188f261c25 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:48.581140 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-48d2ddb0-aef7-4922-a526-14188f261c25 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:48.582723 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-48d2ddb0-aef7-4922-a526-14188f261c25 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:48.583430 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-48d2ddb0-aef7-4922-a526-14188f261c25 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:48.583970 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-48d2ddb0-aef7-4922-a526-14188f261c25 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:48.652370 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-48d2ddb0-aef7-4922-a526-14188f261c25 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:48.663390 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-48d2ddb0-aef7-4922-a526-14188f261c25 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1266 microversion: 2.1 time: 0.103860 May 13 17:29:48.664121 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 236/465] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:48 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:48.696574 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-43c07faa-8ce2-4a36-94b1-c29b324e1318 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:48.705000 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-43c07faa-8ce2-4a36-94b1-c29b324e1318 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.190971 May 13 17:29:48.716497 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 230/466] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:48 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:49.269669 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-596be671-acc4-4aca-89e1-ab8a06f70e45 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:49.270415 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-596be671-acc4-4aca-89e1-ab8a06f70e45 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:49.276740 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-596be671-acc4-4aca-89e1-ab8a06f70e45 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:49.277192 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-596be671-acc4-4aca-89e1-ab8a06f70e45 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:49.277970 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-596be671-acc4-4aca-89e1-ab8a06f70e45 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:49.278412 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-596be671-acc4-4aca-89e1-ab8a06f70e45 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:49.405397 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-596be671-acc4-4aca-89e1-ab8a06f70e45 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:49.412586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-596be671-acc4-4aca-89e1-ab8a06f70e45 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.147377 May 13 17:29:49.413183 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 237/467] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:49 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:49.680866 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e2ee0fe6-0fe7-4384-b589-907694a0cc01 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:49.681476 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e2ee0fe6-0fe7-4384-b589-907694a0cc01 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:49.687738 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e2ee0fe6-0fe7-4384-b589-907694a0cc01 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:49.688189 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e2ee0fe6-0fe7-4384-b589-907694a0cc01 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:49.688961 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e2ee0fe6-0fe7-4384-b589-907694a0cc01 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:49.689395 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e2ee0fe6-0fe7-4384-b589-907694a0cc01 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:49.726538 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-2f8542d6-3f58-4b12-b530-58bc6286be7a tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:49.727748 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-2f8542d6-3f58-4b12-b530-58bc6286be7a tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:49.736589 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2f8542d6-3f58-4b12-b530-58bc6286be7a tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:49.737460 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2f8542d6-3f58-4b12-b530-58bc6286be7a tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:49.738790 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2f8542d6-3f58-4b12-b530-58bc6286be7a tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:49.739414 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2f8542d6-3f58-4b12-b530-58bc6286be7a tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:49.776953 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e2ee0fe6-0fe7-4384-b589-907694a0cc01 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:49.779997 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e2ee0fe6-0fe7-4384-b589-907694a0cc01 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1274 microversion: 2.1 time: 0.102974 May 13 17:29:49.781622 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 231/468] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:49 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1274 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:49.886488 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-2f8542d6-3f58-4b12-b530-58bc6286be7a tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:49.894998 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-2f8542d6-3f58-4b12-b530-58bc6286be7a tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.174016 May 13 17:29:49.895622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 238/469] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:49 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:50.430132 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-cb017b04-82c4-46ae-a112-09d0c934c839 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:50.430925 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-cb017b04-82c4-46ae-a112-09d0c934c839 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:50.437435 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cb017b04-82c4-46ae-a112-09d0c934c839 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:50.438107 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cb017b04-82c4-46ae-a112-09d0c934c839 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:50.438971 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cb017b04-82c4-46ae-a112-09d0c934c839 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:50.439693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cb017b04-82c4-46ae-a112-09d0c934c839 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:50.524619 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-e69402c2-0a63-4fff-b575-d348f7ad7ef7 req-62773972-0617-4c91-b544-a040872a75db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d07e598b-0481-4f7e-9957-49cd7dbbac98", "name": "network-vif-plugged", "status": "completed", "tag": "53b14020-f762-46c1-859f-588cb62cbd07"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:29:50.534279 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-e69402c2-0a63-4fff-b575-d348f7ad7ef7 req-62773972-0617-4c91-b544-a040872a75db service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:50.535793 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-e69402c2-0a63-4fff-b575-d348f7ad7ef7 req-62773972-0617-4c91-b544-a040872a75db service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:50.549306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-e69402c2-0a63-4fff-b575-d348f7ad7ef7 req-62773972-0617-4c91-b544-a040872a75db service nova] Creating event network-vif-plugged:53b14020-f762-46c1-859f-588cb62cbd07 for instance d07e598b-0481-4f7e-9957-49cd7dbbac98 on hv-cinder-84178 May 13 17:29:50.555503 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-e69402c2-0a63-4fff-b575-d348f7ad7ef7 req-62773972-0617-4c91-b544-a040872a75db service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037833 May 13 17:29:50.556119 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 239/470] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:29:50.671485 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-cb017b04-82c4-46ae-a112-09d0c934c839 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:50.679913 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-cb017b04-82c4-46ae-a112-09d0c934c839 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.254251 May 13 17:29:50.694119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 232/471] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:50 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:50.801733 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-eda24d5a-4c8e-4ef4-9a13-2d32cf077aca tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:50.802652 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-eda24d5a-4c8e-4ef4-9a13-2d32cf077aca tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:50.814272 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-eda24d5a-4c8e-4ef4-9a13-2d32cf077aca tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:50.817044 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-eda24d5a-4c8e-4ef4-9a13-2d32cf077aca tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:50.820421 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-eda24d5a-4c8e-4ef4-9a13-2d32cf077aca tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:50.821074 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-eda24d5a-4c8e-4ef4-9a13-2d32cf077aca tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:50.898840 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e1606680-9c39-45e3-b07a-fffcff540c39 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-669113376", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-442032391", "security_groups": [{"name": "tempest-secgroup-smoke-651309795"}], "networks": [{"uuid": "2f334e29-3120-4ec7-b43a-0baf54e47be7"}], "block_device_mapping_v2": [{"uuid": "f86dc5a9-f3e0-4a34-8d6b-4830da34dcef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:29:50.966595 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-eda24d5a-4c8e-4ef4-9a13-2d32cf077aca tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:50.977419 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-eda24d5a-4c8e-4ef4-9a13-2d32cf077aca tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1274 microversion: 2.1 time: 0.182039 May 13 17:29:50.998950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 240/472] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:50 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1274 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:51.004709 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-9f41c809-f66b-4d00-bb3a-afaebb684120 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:51.005541 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-9f41c809-f66b-4d00-bb3a-afaebb684120 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:51.015283 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9f41c809-f66b-4d00-bb3a-afaebb684120 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:51.015736 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9f41c809-f66b-4d00-bb3a-afaebb684120 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:51.016519 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9f41c809-f66b-4d00-bb3a-afaebb684120 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:51.017190 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9f41c809-f66b-4d00-bb3a-afaebb684120 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:51.114150 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.network.neutron [None req-e1606680-9c39-45e3-b07a-fffcff540c39 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] validate_networks() for [('2f334e29-3120-4ec7-b43a-0baf54e47be7', None, None, None, None, None)] {{(pid=117493) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 17:29:51.174125 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-9f41c809-f66b-4d00-bb3a-afaebb684120 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:51.182347 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-9f41c809-f66b-4d00-bb3a-afaebb684120 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.182775 May 13 17:29:51.192374 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 241/473] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:50 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:51.697219 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6ba48b55-34da-477d-b82e-cf655da78435 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:51.697858 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6ba48b55-34da-477d-b82e-cf655da78435 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:51.705679 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6ba48b55-34da-477d-b82e-cf655da78435 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:51.706584 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6ba48b55-34da-477d-b82e-cf655da78435 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:51.708413 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6ba48b55-34da-477d-b82e-cf655da78435 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:51.708862 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6ba48b55-34da-477d-b82e-cf655da78435 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:51.855464 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6ba48b55-34da-477d-b82e-cf655da78435 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:51.874950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6ba48b55-34da-477d-b82e-cf655da78435 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1522 microversion: 2.1 time: 0.181578 May 13 17:29:51.875967 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 242/474] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:51 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:51.989003 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-e1606680-9c39-45e3-b07a-fffcff540c39 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Flavor limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 17:29:51.990049 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-e1606680-9c39-45e3-b07a-fffcff540c39 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Image limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 17:29:51.990670 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-e1606680-9c39-45e3-b07a-fffcff540c39 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Flavor pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 17:29:51.996156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-e1606680-9c39-45e3-b07a-fffcff540c39 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Image pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 17:29:51.996156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-e1606680-9c39-45e3-b07a-fffcff540c39 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 17:29:52.002706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e1606680-9c39-45e3-b07a-fffcff540c39 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:52.003002 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-ac2b0bd2-6659-4291-b55b-afb694e9d3c3 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:52.003181 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e1606680-9c39-45e3-b07a-fffcff540c39 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:52.004236 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-ac2b0bd2-6659-4291-b55b-afb694e9d3c3 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:52.004625 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e1606680-9c39-45e3-b07a-fffcff540c39 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:52.005069 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e1606680-9c39-45e3-b07a-fffcff540c39 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:52.009995 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ac2b0bd2-6659-4291-b55b-afb694e9d3c3 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:52.010441 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ac2b0bd2-6659-4291-b55b-afb694e9d3c3 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:52.011331 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ac2b0bd2-6659-4291-b55b-afb694e9d3c3 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:52.019802 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ac2b0bd2-6659-4291-b55b-afb694e9d3c3 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:52.022315 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-e1606680-9c39-45e3-b07a-fffcff540c39 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Getting quotas for project 15f2d05b5ad248009d2acb0d3db6aec9. Resources: {'ram', 'instances', 'cores'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:29:52.026040 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-e1606680-9c39-45e3-b07a-fffcff540c39 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Getting quotas for user 72919bd9efe84fa8acf2b407d7b6b13d and project 15f2d05b5ad248009d2acb0d3db6aec9. Resources: {'ram', 'instances', 'cores'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:29:52.072163 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-ac2b0bd2-6659-4291-b55b-afb694e9d3c3 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:52.082467 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-ac2b0bd2-6659-4291-b55b-afb694e9d3c3 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1272 microversion: 2.1 time: 0.083766 May 13 17:29:52.082467 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 243/475] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:51 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1272 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:52.085979 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e1606680-9c39-45e3-b07a-fffcff540c39 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Going to run 1 instances... {{(pid=117493) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 17:29:52.088205 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e1606680-9c39-45e3-b07a-fffcff540c39 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f86dc5a9-f3e0-4a34-8d6b-4830da34dcef',volume_size=None,volume_type=None)] {{(pid=117493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 17:29:52.200453 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-70712849-e0f8-40a5-98d6-0199188361ac tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:52.201088 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-70712849-e0f8-40a5-98d6-0199188361ac tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:52.207498 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-70712849-e0f8-40a5-98d6-0199188361ac tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:52.207954 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-70712849-e0f8-40a5-98d6-0199188361ac tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:52.208783 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-70712849-e0f8-40a5-98d6-0199188361ac tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:52.209227 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-70712849-e0f8-40a5-98d6-0199188361ac tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:52.351838 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-70712849-e0f8-40a5-98d6-0199188361ac tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:52.360618 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-70712849-e0f8-40a5-98d6-0199188361ac tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.164873 May 13 17:29:52.361183 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 244/476] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:52 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:52.534468 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e1606680-9c39-45e3-b07a-fffcff540c39 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.639527 May 13 17:29:52.535659 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 233/477] 10.222.0.64 () {60 vars in 1146 bytes} [Fri May 13 17:29:50 2022] POST /compute/v2.1/servers => generated 405 bytes in 1641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 17:29:52.545771 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f1644e07-5f38-4a29-82ad-40325e31931c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:52.546377 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-f1644e07-5f38-4a29-82ad-40325e31931c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:52.600072 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f1644e07-5f38-4a29-82ad-40325e31931c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:52.606579 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f1644e07-5f38-4a29-82ad-40325e31931c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1087 microversion: 2.1 time: 0.064537 May 13 17:29:52.607362 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 245/478] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:52 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1087 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:52.895521 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0534a8d0-e9c2-4f90-afb0-05ca859ac768 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:52.896176 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0534a8d0-e9c2-4f90-afb0-05ca859ac768 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:52.902241 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0534a8d0-e9c2-4f90-afb0-05ca859ac768 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:52.902748 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0534a8d0-e9c2-4f90-afb0-05ca859ac768 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:52.903555 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0534a8d0-e9c2-4f90-afb0-05ca859ac768 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:52.904532 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0534a8d0-e9c2-4f90-afb0-05ca859ac768 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:53.096839 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-5f78b7c0-06f5-45e5-bed7-52fdcdf485b4 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:53.097519 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-5f78b7c0-06f5-45e5-bed7-52fdcdf485b4 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:53.103825 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5f78b7c0-06f5-45e5-bed7-52fdcdf485b4 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:53.104275 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5f78b7c0-06f5-45e5-bed7-52fdcdf485b4 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:53.105045 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5f78b7c0-06f5-45e5-bed7-52fdcdf485b4 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:53.105481 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5f78b7c0-06f5-45e5-bed7-52fdcdf485b4 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:53.114876 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0534a8d0-e9c2-4f90-afb0-05ca859ac768 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:53.125062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0534a8d0-e9c2-4f90-afb0-05ca859ac768 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1502 microversion: 2.1 time: 0.233758 May 13 17:29:53.125932 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 234/479] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:52 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1502 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:53.153936 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3254fb9b-1e00-4b56-b780-2426cde3df58 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:53.154715 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3254fb9b-1e00-4b56-b780-2426cde3df58 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:53.161017 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3254fb9b-1e00-4b56-b780-2426cde3df58 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:53.161560 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3254fb9b-1e00-4b56-b780-2426cde3df58 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:53.162448 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3254fb9b-1e00-4b56-b780-2426cde3df58 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:53.162984 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3254fb9b-1e00-4b56-b780-2426cde3df58 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:53.262000 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-5f78b7c0-06f5-45e5-bed7-52fdcdf485b4 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:53.269316 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-5f78b7c0-06f5-45e5-bed7-52fdcdf485b4 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1314 microversion: 2.1 time: 0.176525 May 13 17:29:53.269977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 246/480] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:53 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:53.368604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3254fb9b-1e00-4b56-b780-2426cde3df58 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:53.376420 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3254fb9b-1e00-4b56-b780-2426cde3df58 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1514 microversion: 2.1 time: 0.226870 May 13 17:29:53.376991 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 235/481] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:53 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1514 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:53.388043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-01fceedf-4a31-4a44-a708-8645c9088577 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:53.388043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-01fceedf-4a31-4a44-a708-8645c9088577 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:53.388043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-01fceedf-4a31-4a44-a708-8645c9088577 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:53.388043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-01fceedf-4a31-4a44-a708-8645c9088577 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:53.388397 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-01fceedf-4a31-4a44-a708-8645c9088577 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:53.388397 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-01fceedf-4a31-4a44-a708-8645c9088577 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:53.561291 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-01fceedf-4a31-4a44-a708-8645c9088577 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:53.569299 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-01fceedf-4a31-4a44-a708-8645c9088577 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1359 microversion: 2.1 time: 0.195621 May 13 17:29:53.578567 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 247/482] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:53 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1359 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:53.623121 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6e820d2b-b2f0-4551-a143-f0906fbf7f91 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:53.623679 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6e820d2b-b2f0-4551-a143-f0906fbf7f91 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:53.682624 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6e820d2b-b2f0-4551-a143-f0906fbf7f91 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:53.689069 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6e820d2b-b2f0-4551-a143-f0906fbf7f91 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1087 microversion: 2.1 time: 0.069834 May 13 17:29:53.689631 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 236/483] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:53 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1087 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:53.888123 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-128ac2f9-3316-4976-8017-9c00d4ed9532 req-5604b97f-a58b-4f46-b79b-b92332ffbc92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "686847ed-a4cd-42fe-ae51-44ce52cf1ae4", "tag": "c62b5b29-b80a-46ee-971c-66d386497347"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:29:53.900185 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-128ac2f9-3316-4976-8017-9c00d4ed9532 req-5604b97f-a58b-4f46-b79b-b92332ffbc92 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:53.900983 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-128ac2f9-3316-4976-8017-9c00d4ed9532 req-5604b97f-a58b-4f46-b79b-b92332ffbc92 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:53.920141 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a8a6db8b-3673-461a-ac8d-4a0ceada022a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1392714799", "imageRef": "7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88", "flavorRef": "452", "networks": [{"uuid": "43080e60-e3bd-4f01-9af9-50b6a3bc0c46"}]}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:29:53.920781 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-128ac2f9-3316-4976-8017-9c00d4ed9532 req-5604b97f-a58b-4f46-b79b-b92332ffbc92 service nova] Creating event network-changed:c62b5b29-b80a-46ee-971c-66d386497347 for instance 686847ed-a4cd-42fe-ae51-44ce52cf1ae4 on hv-cinder-84178 May 13 17:29:53.925914 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-128ac2f9-3316-4976-8017-9c00d4ed9532 req-5604b97f-a58b-4f46-b79b-b92332ffbc92 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041134 May 13 17:29:53.927527 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 248/484] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:29:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:29:53.981395 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.network.neutron [None req-a8a6db8b-3673-461a-ac8d-4a0ceada022a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] validate_networks() for [('43080e60-e3bd-4f01-9af9-50b6a3bc0c46', None, None, None, None, None)] {{(pid=117493) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 17:29:54.287491 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-5ae5e277-f6ed-42cd-a584-3281c59031b2 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:54.288301 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-5ae5e277-f6ed-42cd-a584-3281c59031b2 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:54.294599 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5ae5e277-f6ed-42cd-a584-3281c59031b2 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:54.295160 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5ae5e277-f6ed-42cd-a584-3281c59031b2 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:54.296015 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5ae5e277-f6ed-42cd-a584-3281c59031b2 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:54.296542 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5ae5e277-f6ed-42cd-a584-3281c59031b2 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:54.354664 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-a8a6db8b-3673-461a-ac8d-4a0ceada022a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Flavor limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 17:29:54.355176 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-a8a6db8b-3673-461a-ac8d-4a0ceada022a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Image limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 17:29:54.355779 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-a8a6db8b-3673-461a-ac8d-4a0ceada022a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Flavor pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 17:29:54.356286 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-a8a6db8b-3673-461a-ac8d-4a0ceada022a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Image pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 17:29:54.356703 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-a8a6db8b-3673-461a-ac8d-4a0ceada022a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 17:29:54.366177 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a8a6db8b-3673-461a-ac8d-4a0ceada022a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:54.366826 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a8a6db8b-3673-461a-ac8d-4a0ceada022a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:54.367848 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a8a6db8b-3673-461a-ac8d-4a0ceada022a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:54.368288 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a8a6db8b-3673-461a-ac8d-4a0ceada022a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:54.385202 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-a8a6db8b-3673-461a-ac8d-4a0ceada022a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Getting quotas for project e9f5f08db8cb40f0857115f4c9aadaf7. Resources: {'ram', 'instances', 'cores'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:29:54.389241 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-a8a6db8b-3673-461a-ac8d-4a0ceada022a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Getting quotas for user 00983ee7706f43d4b3f7d0f178c0e924 and project e9f5f08db8cb40f0857115f4c9aadaf7. Resources: {'ram', 'instances', 'cores'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:29:54.408977 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a8a6db8b-3673-461a-ac8d-4a0ceada022a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Going to run 1 instances... {{(pid=117493) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 17:29:54.411585 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a8a6db8b-3673-461a-ac8d-4a0ceada022a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 17:29:54.441865 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-5ae5e277-f6ed-42cd-a584-3281c59031b2 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:54.450011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-5ae5e277-f6ed-42cd-a584-3281c59031b2 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1314 microversion: 2.1 time: 0.167819 May 13 17:29:54.450498 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 249/485] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:54 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:54.511501 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a8a6db8b-3673-461a-ac8d-4a0ceada022a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.595324 May 13 17:29:54.512136 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 237/486] 10.222.0.64 () {60 vars in 1146 bytes} [Fri May 13 17:29:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 17:29:54.521804 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-18ae11e2-ad91-4b2c-af94-6d82d374814a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:54.522403 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-18ae11e2-ad91-4b2c-af94-6d82d374814a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:54.573237 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-18ae11e2-ad91-4b2c-af94-6d82d374814a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:54.579632 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-18ae11e2-ad91-4b2c-af94-6d82d374814a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 200 len: 1219 microversion: 2.1 time: 0.061585 May 13 17:29:54.580191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 250/487] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:54 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 1219 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:54.589558 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-25b4605b-7384-451e-ba7a-3f4d0506db30 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:54.589558 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-25b4605b-7384-451e-ba7a-3f4d0506db30 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:54.594022 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-25b4605b-7384-451e-ba7a-3f4d0506db30 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:54.594541 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-25b4605b-7384-451e-ba7a-3f4d0506db30 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:54.595667 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-25b4605b-7384-451e-ba7a-3f4d0506db30 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:54.596245 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-25b4605b-7384-451e-ba7a-3f4d0506db30 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:54.705840 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-807bb308-fddd-48be-955f-f22ac4841dd1 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:54.706474 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-807bb308-fddd-48be-955f-f22ac4841dd1 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:54.714226 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-807bb308-fddd-48be-955f-f22ac4841dd1 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:54.714671 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-807bb308-fddd-48be-955f-f22ac4841dd1 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:54.715486 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-807bb308-fddd-48be-955f-f22ac4841dd1 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:54.715927 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-807bb308-fddd-48be-955f-f22ac4841dd1 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:54.729718 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-25b4605b-7384-451e-ba7a-3f4d0506db30 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:54.737840 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-25b4605b-7384-451e-ba7a-3f4d0506db30 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1549 microversion: 2.1 time: 0.155055 May 13 17:29:54.738393 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 238/488] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:54 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1549 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:54.753930 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-35afd7d5-9754-45b5-8f24-c6198232bafa tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:54.754615 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-35afd7d5-9754-45b5-8f24-c6198232bafa tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:54.762178 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-35afd7d5-9754-45b5-8f24-c6198232bafa tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:54.767700 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-35afd7d5-9754-45b5-8f24-c6198232bafa tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:54.767700 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-35afd7d5-9754-45b5-8f24-c6198232bafa tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:54.767700 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-35afd7d5-9754-45b5-8f24-c6198232bafa tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:54.779361 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-807bb308-fddd-48be-955f-f22ac4841dd1 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:54.799060 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-807bb308-fddd-48be-955f-f22ac4841dd1 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1137 microversion: 2.1 time: 0.097052 May 13 17:29:54.800268 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 251/489] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:54 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1137 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:54.916028 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-35afd7d5-9754-45b5-8f24-c6198232bafa tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:54.923462 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-35afd7d5-9754-45b5-8f24-c6198232bafa tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1549 microversion: 2.1 time: 0.173134 May 13 17:29:54.923954 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 239/490] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:54 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1549 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:54.942514 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-28fb704b-41c3-4a45-92aa-e24ada75b737 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:54.946176 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-28fb704b-41c3-4a45-92aa-e24ada75b737 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:54.946997 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-28fb704b-41c3-4a45-92aa-e24ada75b737 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Searching by: {'deleted': False, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d'} {{(pid=117492) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 13 17:29:54.953648 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-28fb704b-41c3-4a45-92aa-e24ada75b737 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:54.957412 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-28fb704b-41c3-4a45-92aa-e24ada75b737 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:54.957412 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-28fb704b-41c3-4a45-92aa-e24ada75b737 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:54.957412 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-28fb704b-41c3-4a45-92aa-e24ada75b737 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:55.048543 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.multi_cell_list [None req-28fb704b-41c3-4a45-92aa-e24ada75b737 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117492) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 13 17:29:55.148209 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-28fb704b-41c3-4a45-92aa-e24ada75b737 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.210099 May 13 17:29:55.148806 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 252/491] 10.222.0.64 () {58 vars in 1124 bytes} [Fri May 13 17:29:54 2022] GET /compute/v2.1/servers => generated 343 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:29:55.159386 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e9f01c7b-21d1-40ee-b0f4-0f5cafd5b78f tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:55.160011 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e9f01c7b-21d1-40ee-b0f4-0f5cafd5b78f tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:55.166110 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e9f01c7b-21d1-40ee-b0f4-0f5cafd5b78f tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:55.166560 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e9f01c7b-21d1-40ee-b0f4-0f5cafd5b78f tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:55.167359 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e9f01c7b-21d1-40ee-b0f4-0f5cafd5b78f tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:55.167794 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e9f01c7b-21d1-40ee-b0f4-0f5cafd5b78f tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:55.297668 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e9f01c7b-21d1-40ee-b0f4-0f5cafd5b78f tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:55.305090 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e9f01c7b-21d1-40ee-b0f4-0f5cafd5b78f tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1549 microversion: 2.1 time: 0.149651 May 13 17:29:55.305691 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 240/492] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:55 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:55.467388 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f6d4dfca-6d24-4f6d-b070-7f8a62551f42 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:55.468010 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-f6d4dfca-6d24-4f6d-b070-7f8a62551f42 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:55.474963 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f6d4dfca-6d24-4f6d-b070-7f8a62551f42 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:55.475453 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f6d4dfca-6d24-4f6d-b070-7f8a62551f42 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:55.476455 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f6d4dfca-6d24-4f6d-b070-7f8a62551f42 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:55.476895 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f6d4dfca-6d24-4f6d-b070-7f8a62551f42 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:55.597370 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-278d4352-f44b-4a7d-8a60-809b89f62900 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:55.597979 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-278d4352-f44b-4a7d-8a60-809b89f62900 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:55.603820 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-278d4352-f44b-4a7d-8a60-809b89f62900 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:55.604274 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-278d4352-f44b-4a7d-8a60-809b89f62900 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:55.605145 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-278d4352-f44b-4a7d-8a60-809b89f62900 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:55.605535 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-278d4352-f44b-4a7d-8a60-809b89f62900 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:55.607590 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f6d4dfca-6d24-4f6d-b070-7f8a62551f42 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:55.615342 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f6d4dfca-6d24-4f6d-b070-7f8a62551f42 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1314 microversion: 2.1 time: 0.153439 May 13 17:29:55.615917 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 253/493] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:55 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:55.666119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-278d4352-f44b-4a7d-8a60-809b89f62900 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:55.673618 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-278d4352-f44b-4a7d-8a60-809b89f62900 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 200 len: 1223 microversion: 2.1 time: 0.080368 May 13 17:29:55.674265 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 241/494] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:55 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 1223 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:55.816623 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-41faec13-4523-400d-803c-931ede0979ae tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:55.817148 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-41faec13-4523-400d-803c-931ede0979ae tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:55.823507 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-41faec13-4523-400d-803c-931ede0979ae tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:55.823963 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-41faec13-4523-400d-803c-931ede0979ae tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:55.824735 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-41faec13-4523-400d-803c-931ede0979ae tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:55.825167 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-41faec13-4523-400d-803c-931ede0979ae tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:55.888307 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-41faec13-4523-400d-803c-931ede0979ae tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:55.895850 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-41faec13-4523-400d-803c-931ede0979ae tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1185 microversion: 2.1 time: 0.083317 May 13 17:29:55.896443 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 254/495] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:55 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:56.157870 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-86dea8e9-1606-4f9f-b2a8-2495e1848bc6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:29:56.159173 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-86dea8e9-1606-4f9f-b2a8-2495e1848bc6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:56.166314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-86dea8e9-1606-4f9f-b2a8-2495e1848bc6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:56.166836 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-86dea8e9-1606-4f9f-b2a8-2495e1848bc6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:56.167896 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-86dea8e9-1606-4f9f-b2a8-2495e1848bc6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:56.168544 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-86dea8e9-1606-4f9f-b2a8-2495e1848bc6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:56.213144 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-86dea8e9-1606-4f9f-b2a8-2495e1848bc6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lazy-loading 'flavor' on Instance uuid ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:29:56.544809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-86dea8e9-1606-4f9f-b2a8-2495e1848bc6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "POST /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58/action" status: 200 len: 32 microversion: 2.1 time: 0.390779 May 13 17:29:56.545531 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 242/496] 10.222.0.64 () {60 vars in 1277 bytes} [Fri May 13 17:29:56 2022] POST /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58/action => generated 32 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 17:29:56.554930 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1459e33a-67b0-4c2a-9b58-4574915f1e96 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:56.555562 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-1459e33a-67b0-4c2a-9b58-4574915f1e96 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:56.561862 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1459e33a-67b0-4c2a-9b58-4574915f1e96 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:56.562307 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1459e33a-67b0-4c2a-9b58-4574915f1e96 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:56.563458 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1459e33a-67b0-4c2a-9b58-4574915f1e96 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:56.563887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1459e33a-67b0-4c2a-9b58-4574915f1e96 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:56.633020 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-992a3e72-f4cb-4e41-a00f-02e90d299d30 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:56.634094 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-992a3e72-f4cb-4e41-a00f-02e90d299d30 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:56.641982 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-992a3e72-f4cb-4e41-a00f-02e90d299d30 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:56.642429 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-992a3e72-f4cb-4e41-a00f-02e90d299d30 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:56.643266 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-992a3e72-f4cb-4e41-a00f-02e90d299d30 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:56.643702 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-992a3e72-f4cb-4e41-a00f-02e90d299d30 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:56.702854 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-1459e33a-67b0-4c2a-9b58-4574915f1e96 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:56.712483 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-1459e33a-67b0-4c2a-9b58-4574915f1e96 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.161721 May 13 17:29:56.713857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 255/497] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:56 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:56.719889 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-e368d7b6-23a1-4efb-8fcf-93877cdc1f0f tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:56.721076 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-e368d7b6-23a1-4efb-8fcf-93877cdc1f0f tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:56.727881 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e368d7b6-23a1-4efb-8fcf-93877cdc1f0f tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:56.729918 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e368d7b6-23a1-4efb-8fcf-93877cdc1f0f tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:56.730767 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e368d7b6-23a1-4efb-8fcf-93877cdc1f0f tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:56.731236 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e368d7b6-23a1-4efb-8fcf-93877cdc1f0f tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:56.795501 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-e368d7b6-23a1-4efb-8fcf-93877cdc1f0f tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:56.798031 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-992a3e72-f4cb-4e41-a00f-02e90d299d30 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:56.803472 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-e368d7b6-23a1-4efb-8fcf-93877cdc1f0f tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 200 len: 1215 microversion: 2.1 time: 0.088060 May 13 17:29:56.804060 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 256/498] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:56 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:56.805171 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-992a3e72-f4cb-4e41-a00f-02e90d299d30 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1314 microversion: 2.1 time: 0.177004 May 13 17:29:56.807408 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 243/499] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:56 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:56.912528 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-681c5e3b-9caa-4548-bef4-0059362dd378 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:56.913139 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-681c5e3b-9caa-4548-bef4-0059362dd378 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:56.919156 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-681c5e3b-9caa-4548-bef4-0059362dd378 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:56.919750 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-681c5e3b-9caa-4548-bef4-0059362dd378 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:56.920528 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-681c5e3b-9caa-4548-bef4-0059362dd378 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:56.920970 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-681c5e3b-9caa-4548-bef4-0059362dd378 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:56.982739 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-681c5e3b-9caa-4548-bef4-0059362dd378 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:56.990776 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-681c5e3b-9caa-4548-bef4-0059362dd378 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1193 microversion: 2.1 time: 0.082147 May 13 17:29:56.991380 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 257/500] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:56 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1193 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:57.309968 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-146e41b8-d30f-4889-ab96-18b4359790d0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Action: 'create', calling method: .version_select at 0x7fa08464f5e0>, body: {"keypair": {"name": "tempest-keypair-879829482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJD9jHuzPlmaI3Dq7HWeheYhROU+6jUBDPfQNDLb0FhPTIhpZLrk07WTBjj2Ra8+Elfzvy3ZArxe+MkMyTogr+fLNN0veouNTU1fFuzZWWatXFQvk+CkfPBlF+GFlmBdsg=="}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:29:57.324169 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-146e41b8-d30f-4889-ab96-18b4359790d0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Getting quotas for project ae7b37b41d944427945d783a460ca12a. Resources: {'key_pairs'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:29:57.327887 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-146e41b8-d30f-4889-ab96-18b4359790d0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Getting quotas for user dfc52b61bcf845d1953a5a111abb3666 and project ae7b37b41d944427945d783a460ca12a. Resources: {'key_pairs'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:29:57.420340 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-146e41b8-d30f-4889-ab96-18b4359790d0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.114178 May 13 17:29:57.420933 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 244/501] 10.222.0.64 () {60 vars in 1158 bytes} [Fri May 13 17:29:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:29:57.730290 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1ed55201-40b0-4b41-b543-b7ed0f491f3a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:57.730903 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-1ed55201-40b0-4b41-b543-b7ed0f491f3a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:57.737377 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1ed55201-40b0-4b41-b543-b7ed0f491f3a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:57.737827 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1ed55201-40b0-4b41-b543-b7ed0f491f3a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:57.739185 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1ed55201-40b0-4b41-b543-b7ed0f491f3a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:57.739635 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1ed55201-40b0-4b41-b543-b7ed0f491f3a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:57.821649 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fc188460-aaca-497f-bc96-68a932a93ed4 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:57.822271 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fc188460-aaca-497f-bc96-68a932a93ed4 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:57.829084 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fc188460-aaca-497f-bc96-68a932a93ed4 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:57.829560 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fc188460-aaca-497f-bc96-68a932a93ed4 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:57.830336 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fc188460-aaca-497f-bc96-68a932a93ed4 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:57.830770 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fc188460-aaca-497f-bc96-68a932a93ed4 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:57.871467 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-1ed55201-40b0-4b41-b543-b7ed0f491f3a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:57.879674 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-1ed55201-40b0-4b41-b543-b7ed0f491f3a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.152482 May 13 17:29:57.887289 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 258/502] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:57 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:57.887289 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7279a1b8-816e-4f90-9331-5f402d801021 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:57.887289 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7279a1b8-816e-4f90-9331-5f402d801021 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:57.891297 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7279a1b8-816e-4f90-9331-5f402d801021 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:57.891817 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7279a1b8-816e-4f90-9331-5f402d801021 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:57.892573 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7279a1b8-816e-4f90-9331-5f402d801021 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:57.893030 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7279a1b8-816e-4f90-9331-5f402d801021 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:57.902703 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fc188460-aaca-497f-bc96-68a932a93ed4 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:57.916412 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fc188460-aaca-497f-bc96-68a932a93ed4 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 200 len: 1271 microversion: 2.1 time: 0.098701 May 13 17:29:57.924213 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 245/503] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:57 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 1271 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:58.008596 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-55ffe4b3-1ad7-44f2-862e-617732bb3790 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:58.009234 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-55ffe4b3-1ad7-44f2-862e-617732bb3790 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:58.015024 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-55ffe4b3-1ad7-44f2-862e-617732bb3790 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:58.015505 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-55ffe4b3-1ad7-44f2-862e-617732bb3790 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:58.016272 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-55ffe4b3-1ad7-44f2-862e-617732bb3790 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:58.016705 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-55ffe4b3-1ad7-44f2-862e-617732bb3790 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:58.023925 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7279a1b8-816e-4f90-9331-5f402d801021 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:58.029553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7279a1b8-816e-4f90-9331-5f402d801021 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1314 microversion: 2.1 time: 0.148346 May 13 17:29:58.030362 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 259/504] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:57 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:58.089574 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-55ffe4b3-1ad7-44f2-862e-617732bb3790 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:58.097205 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-55ffe4b3-1ad7-44f2-862e-617732bb3790 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1193 microversion: 2.1 time: 0.092460 May 13 17:29:58.098262 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 246/505] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:58 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1193 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:58.529834 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-624f4930-4848-4062-8134-6b17846f22f9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "994b59dd-1be8-42b4-bdf7-5d7c87ff1a16"}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:29:58.530993 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-624f4930-4848-4062-8134-6b17846f22f9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:58.538335 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-624f4930-4848-4062-8134-6b17846f22f9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:58.538794 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-624f4930-4848-4062-8134-6b17846f22f9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:58.539583 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-624f4930-4848-4062-8134-6b17846f22f9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:58.540012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-624f4930-4848-4062-8134-6b17846f22f9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:58.897768 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9a4003e9-16b9-455b-8bbd-9a7b023dab26 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:58.898378 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9a4003e9-16b9-455b-8bbd-9a7b023dab26 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:58.904850 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a4003e9-16b9-455b-8bbd-9a7b023dab26 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:58.905307 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a4003e9-16b9-455b-8bbd-9a7b023dab26 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:58.909192 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a4003e9-16b9-455b-8bbd-9a7b023dab26 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:58.909192 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a4003e9-16b9-455b-8bbd-9a7b023dab26 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:59.111084 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9a4003e9-16b9-455b-8bbd-9a7b023dab26 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:59.118840 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9a4003e9-16b9-455b-8bbd-9a7b023dab26 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.225644 May 13 17:29:59.119431 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 247/506] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:58 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:29:59.123709 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c06cc2b2-a9c7-482d-8046-c47e7c0696d0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:59.124302 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c06cc2b2-a9c7-482d-8046-c47e7c0696d0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:59.130445 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c06cc2b2-a9c7-482d-8046-c47e7c0696d0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:59.130894 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c06cc2b2-a9c7-482d-8046-c47e7c0696d0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:59.131677 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c06cc2b2-a9c7-482d-8046-c47e7c0696d0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:59.132116 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c06cc2b2-a9c7-482d-8046-c47e7c0696d0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:59.197032 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c06cc2b2-a9c7-482d-8046-c47e7c0696d0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:59.204432 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c06cc2b2-a9c7-482d-8046-c47e7c0696d0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 200 len: 1271 microversion: 2.1 time: 0.084056 May 13 17:29:59.205134 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 248/507] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:59 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:59.210410 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d030eead-e856-4f65-9f7b-8d6bf725e0f1 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:59.211251 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d030eead-e856-4f65-9f7b-8d6bf725e0f1 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:59.216881 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d030eead-e856-4f65-9f7b-8d6bf725e0f1 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:59.217338 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d030eead-e856-4f65-9f7b-8d6bf725e0f1 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:59.218110 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d030eead-e856-4f65-9f7b-8d6bf725e0f1 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:59.218552 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d030eead-e856-4f65-9f7b-8d6bf725e0f1 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:59.417718 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d030eead-e856-4f65-9f7b-8d6bf725e0f1 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:59.424922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d030eead-e856-4f65-9f7b-8d6bf725e0f1 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1314 microversion: 2.1 time: 0.218773 May 13 17:29:59.434527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 249/508] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:59 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:59.434527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-dfa1802a-7cde-4303-b6c3-ba7ba76c9dbd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:29:59.434527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-dfa1802a-7cde-4303-b6c3-ba7ba76c9dbd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:29:59.436868 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dfa1802a-7cde-4303-b6c3-ba7ba76c9dbd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:59.437314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dfa1802a-7cde-4303-b6c3-ba7ba76c9dbd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:59.438102 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dfa1802a-7cde-4303-b6c3-ba7ba76c9dbd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:29:59.438531 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dfa1802a-7cde-4303-b6c3-ba7ba76c9dbd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:29:59.498980 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-dfa1802a-7cde-4303-b6c3-ba7ba76c9dbd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:29:59.506833 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-dfa1802a-7cde-4303-b6c3-ba7ba76c9dbd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1193 microversion: 2.1 time: 0.079858 May 13 17:29:59.507427 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 250/509] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:29:59 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1193 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:29:59.792062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-36b6de5b-af7d-4e13-839c-da76eb27df32 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1637534088", "imageRef": "7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88108179-f685-4c21-8286-b31593459871"}], "security_groups": [{"name": "tempest-securitygroup--1457312114"}], "key_name": "tempest-keypair-879829482", "user_data": "}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:29:59.893545 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.network.neutron [None req-36b6de5b-af7d-4e13-839c-da76eb27df32 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] validate_networks() for [('88108179-f685-4c21-8286-b31593459871', None, None, None, None, None)] {{(pid=117493) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 17:30:00.539217 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-36b6de5b-af7d-4e13-839c-da76eb27df32 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Flavor limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 17:30:00.541598 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-36b6de5b-af7d-4e13-839c-da76eb27df32 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Image limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 17:30:00.542332 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-36b6de5b-af7d-4e13-839c-da76eb27df32 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Flavor pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 17:30:00.542874 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-36b6de5b-af7d-4e13-839c-da76eb27df32 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Image pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 17:30:00.543444 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-36b6de5b-af7d-4e13-839c-da76eb27df32 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 17:30:00.553768 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-36b6de5b-af7d-4e13-839c-da76eb27df32 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:00.554355 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-36b6de5b-af7d-4e13-839c-da76eb27df32 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:00.555415 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-36b6de5b-af7d-4e13-839c-da76eb27df32 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:00.556051 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-36b6de5b-af7d-4e13-839c-da76eb27df32 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:00.573218 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-36b6de5b-af7d-4e13-839c-da76eb27df32 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Getting quotas for project ae7b37b41d944427945d783a460ca12a. Resources: {'ram', 'instances', 'cores'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:30:00.577892 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-36b6de5b-af7d-4e13-839c-da76eb27df32 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Getting quotas for user dfc52b61bcf845d1953a5a111abb3666 and project ae7b37b41d944427945d783a460ca12a. Resources: {'ram', 'instances', 'cores'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:30:00.589689 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-36b6de5b-af7d-4e13-839c-da76eb27df32 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Going to run 1 instances... {{(pid=117493) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 17:30:00.592071 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-36b6de5b-af7d-4e13-839c-da76eb27df32 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 17:30:00.770541 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-36b6de5b-af7d-4e13-839c-da76eb27df32 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.981879 May 13 17:30:00.772826 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 251/510] 10.222.0.64 () {60 vars in 1146 bytes} [Fri May 13 17:29:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 986 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 13 17:30:00.782679 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-77b95067-d771-407d-84bc-0af4e00187e2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:00.784747 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-77b95067-d771-407d-84bc-0af4e00187e2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:00.786599 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-624f4930-4848-4062-8134-6b17846f22f9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "POST /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.260394 May 13 17:30:00.809487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 260/511] 10.222.0.64 () {60 vars in 1322 bytes} [Fri May 13 17:29:58 2022] POST /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98/os-volume_attachments => generated 194 bytes in 2284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:30:00.849160 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-2f335b2c-c0ce-45a8-9efc-a93f531c1852 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:00.849919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-2f335b2c-c0ce-45a8-9efc-a93f531c1852 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:00.851367 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-77b95067-d771-407d-84bc-0af4e00187e2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:00.853645 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-77b95067-d771-407d-84bc-0af4e00187e2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:00.856820 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-77b95067-d771-407d-84bc-0af4e00187e2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:00.859784 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-77b95067-d771-407d-84bc-0af4e00187e2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:00.876827 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2f335b2c-c0ce-45a8-9efc-a93f531c1852 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:00.879912 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2f335b2c-c0ce-45a8-9efc-a93f531c1852 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:00.881044 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2f335b2c-c0ce-45a8-9efc-a93f531c1852 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:00.881641 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2f335b2c-c0ce-45a8-9efc-a93f531c1852 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:01.011943 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-2f335b2c-c0ce-45a8-9efc-a93f531c1852 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:01.022047 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-2f335b2c-c0ce-45a8-9efc-a93f531c1852 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 200 len: 1289 microversion: 2.1 time: 0.206106 May 13 17:30:01.023035 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 261/512] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:00 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 1289 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:01.029333 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-90036042-7fa6-476d-8285-8b9564f6a31c tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:01.029936 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-90036042-7fa6-476d-8285-8b9564f6a31c tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:01.054855 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-90036042-7fa6-476d-8285-8b9564f6a31c tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:01.056560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-90036042-7fa6-476d-8285-8b9564f6a31c tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:01.057711 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-90036042-7fa6-476d-8285-8b9564f6a31c tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:01.058367 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-90036042-7fa6-476d-8285-8b9564f6a31c tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:01.282469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-90036042-7fa6-476d-8285-8b9564f6a31c tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:01.290654 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-90036042-7fa6-476d-8285-8b9564f6a31c tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1314 microversion: 2.1 time: 0.265525 May 13 17:30:01.291930 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 262/513] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:01 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:01.297150 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d419072a-159b-4a84-aacb-d7ce2579f09d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:01.297754 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d419072a-159b-4a84-aacb-d7ce2579f09d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:01.306471 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d419072a-159b-4a84-aacb-d7ce2579f09d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:01.307326 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d419072a-159b-4a84-aacb-d7ce2579f09d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:01.308172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d419072a-159b-4a84-aacb-d7ce2579f09d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:01.308836 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d419072a-159b-4a84-aacb-d7ce2579f09d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:01.389979 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d419072a-159b-4a84-aacb-d7ce2579f09d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:01.399167 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d419072a-159b-4a84-aacb-d7ce2579f09d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1203 microversion: 2.1 time: 0.105720 May 13 17:30:01.400495 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 263/514] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:01 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1203 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:01.405401 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-880f192e-f62c-4b78-a3f0-891a3766a65e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:01.406071 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-880f192e-f62c-4b78-a3f0-891a3766a65e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:01.474700 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-880f192e-f62c-4b78-a3f0-891a3766a65e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:01.484223 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-77b95067-d771-407d-84bc-0af4e00187e2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:01.494730 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-77b95067-d771-407d-84bc-0af4e00187e2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.719406 May 13 17:30:01.496481 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-880f192e-f62c-4b78-a3f0-891a3766a65e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1241 microversion: 2.1 time: 0.094783 May 13 17:30:01.497267 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 252/515] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:00 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:01.498312 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 264/516] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:01 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1241 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:02.040192 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f3055055-84e5-41e7-b375-ad998554683d tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:02.041647 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-f3055055-84e5-41e7-b375-ad998554683d tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:02.047620 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f3055055-84e5-41e7-b375-ad998554683d tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:02.048175 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f3055055-84e5-41e7-b375-ad998554683d tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:02.049059 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f3055055-84e5-41e7-b375-ad998554683d tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:02.049568 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f3055055-84e5-41e7-b375-ad998554683d tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:02.308940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-066edaa3-e050-4b54-97ae-e319e7da61dc tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:02.309874 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-066edaa3-e050-4b54-97ae-e319e7da61dc tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:02.320984 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f3055055-84e5-41e7-b375-ad998554683d tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:02.322474 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-066edaa3-e050-4b54-97ae-e319e7da61dc tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:02.322928 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-066edaa3-e050-4b54-97ae-e319e7da61dc tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:02.325390 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-066edaa3-e050-4b54-97ae-e319e7da61dc tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:02.325758 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-066edaa3-e050-4b54-97ae-e319e7da61dc tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:02.332434 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f3055055-84e5-41e7-b375-ad998554683d tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 200 len: 1277 microversion: 2.1 time: 0.295468 May 13 17:30:02.333231 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 265/517] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:02 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 1277 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:02.417971 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a30e9c74-dc3a-4d71-95ea-ebeb341faa25 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:02.418731 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a30e9c74-dc3a-4d71-95ea-ebeb341faa25 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:02.425383 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a30e9c74-dc3a-4d71-95ea-ebeb341faa25 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:02.426141 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a30e9c74-dc3a-4d71-95ea-ebeb341faa25 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:02.427309 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a30e9c74-dc3a-4d71-95ea-ebeb341faa25 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:02.427629 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a30e9c74-dc3a-4d71-95ea-ebeb341faa25 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:02.576096 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a30e9c74-dc3a-4d71-95ea-ebeb341faa25 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:02.584210 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a30e9c74-dc3a-4d71-95ea-ebeb341faa25 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.170112 May 13 17:30:02.584787 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 266/518] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:02 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:02.589357 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-8afcf278-1b00-4f8f-bae2-a554eb2bf8f5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:02.589921 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-8afcf278-1b00-4f8f-bae2-a554eb2bf8f5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:02.596517 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8afcf278-1b00-4f8f-bae2-a554eb2bf8f5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:02.596900 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8afcf278-1b00-4f8f-bae2-a554eb2bf8f5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:02.600073 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8afcf278-1b00-4f8f-bae2-a554eb2bf8f5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:02.600613 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8afcf278-1b00-4f8f-bae2-a554eb2bf8f5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:02.622440 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-066edaa3-e050-4b54-97ae-e319e7da61dc tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:02.631800 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-066edaa3-e050-4b54-97ae-e319e7da61dc tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1314 microversion: 2.1 time: 0.326958 May 13 17:30:02.632986 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 253/519] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:02 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1314 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:02.638722 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-66d4434a-752d-4065-bfe7-70d9aef8e9df tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:02.639551 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-66d4434a-752d-4065-bfe7-70d9aef8e9df tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:02.646529 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-66d4434a-752d-4065-bfe7-70d9aef8e9df tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:02.647068 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-66d4434a-752d-4065-bfe7-70d9aef8e9df tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:02.648199 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-66d4434a-752d-4065-bfe7-70d9aef8e9df tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:02.653827 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-66d4434a-752d-4065-bfe7-70d9aef8e9df tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:02.738793 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-66d4434a-752d-4065-bfe7-70d9aef8e9df tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:02.746633 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-66d4434a-752d-4065-bfe7-70d9aef8e9df tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1237 microversion: 2.1 time: 0.111815 May 13 17:30:02.747293 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 254/520] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:02 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1237 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:02.758541 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-8afcf278-1b00-4f8f-bae2-a554eb2bf8f5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:02.766244 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-8afcf278-1b00-4f8f-bae2-a554eb2bf8f5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.180478 May 13 17:30:02.767028 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 267/521] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:02 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:03.256837 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-6e854bd3-3a76-4e9d-ba3c-bab831b3696f req-f2e933b3-2df2-4195-99bd-b840ec5ed7a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "686847ed-a4cd-42fe-ae51-44ce52cf1ae4", "name": "network-vif-plugged", "status": "completed", "tag": "c62b5b29-b80a-46ee-971c-66d386497347"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:30:03.267532 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-6e854bd3-3a76-4e9d-ba3c-bab831b3696f req-f2e933b3-2df2-4195-99bd-b840ec5ed7a3 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:03.268055 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-6e854bd3-3a76-4e9d-ba3c-bab831b3696f req-f2e933b3-2df2-4195-99bd-b840ec5ed7a3 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:03.283933 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-6e854bd3-3a76-4e9d-ba3c-bab831b3696f req-f2e933b3-2df2-4195-99bd-b840ec5ed7a3 service nova] Creating event network-vif-plugged:c62b5b29-b80a-46ee-971c-66d386497347 for instance 686847ed-a4cd-42fe-ae51-44ce52cf1ae4 on hv-cinder-84178 May 13 17:30:03.294862 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-6e854bd3-3a76-4e9d-ba3c-bab831b3696f req-f2e933b3-2df2-4195-99bd-b840ec5ed7a3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042128 May 13 17:30:03.295962 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 255/522] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:30:03.354946 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-098effad-54f4-431e-8357-392bebf6fd73 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:03.356220 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-098effad-54f4-431e-8357-392bebf6fd73 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:03.364563 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-098effad-54f4-431e-8357-392bebf6fd73 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:03.365141 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-098effad-54f4-431e-8357-392bebf6fd73 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:03.367280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-098effad-54f4-431e-8357-392bebf6fd73 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:03.367280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-098effad-54f4-431e-8357-392bebf6fd73 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:03.532343 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-098effad-54f4-431e-8357-392bebf6fd73 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:03.540370 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-098effad-54f4-431e-8357-392bebf6fd73 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 200 len: 1319 microversion: 2.1 time: 0.193494 May 13 17:30:03.549969 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 268/523] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:03 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 1319 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:03.602994 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-05b8c10d-db63-4712-a656-46951789d65d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:03.603728 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-05b8c10d-db63-4712-a656-46951789d65d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:03.609900 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-05b8c10d-db63-4712-a656-46951789d65d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:03.610355 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-05b8c10d-db63-4712-a656-46951789d65d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:03.611213 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-05b8c10d-db63-4712-a656-46951789d65d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:03.611659 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-05b8c10d-db63-4712-a656-46951789d65d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:03.641353 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-b194cee4-6936-445d-880c-1678efc10de6 req-6e0a6a74-e4e8-4841-8d9b-2cefa38aa6cb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a310844-e208-4f17-a8c9-fd4db4acf00d", "tag": "f37d13dd-347a-41e2-8ca5-2b0f1df46c9c"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:30:03.664963 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-b194cee4-6936-445d-880c-1678efc10de6 req-6e0a6a74-e4e8-4841-8d9b-2cefa38aa6cb service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:03.666153 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-b194cee4-6936-445d-880c-1678efc10de6 req-6e0a6a74-e4e8-4841-8d9b-2cefa38aa6cb service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:03.680516 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-b194cee4-6936-445d-880c-1678efc10de6 req-6e0a6a74-e4e8-4841-8d9b-2cefa38aa6cb service nova] Creating event network-changed:f37d13dd-347a-41e2-8ca5-2b0f1df46c9c for instance 7a310844-e208-4f17-a8c9-fd4db4acf00d on hv-cinder-84178 May 13 17:30:03.686041 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-b194cee4-6936-445d-880c-1678efc10de6 req-6e0a6a74-e4e8-4841-8d9b-2cefa38aa6cb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048255 May 13 17:30:03.686806 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 269/524] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:30:03.697040 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-158a594f-c71d-4972-983c-74180ae61691 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:03.698125 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-158a594f-c71d-4972-983c-74180ae61691 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:03.711786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-158a594f-c71d-4972-983c-74180ae61691 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:03.712144 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-158a594f-c71d-4972-983c-74180ae61691 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:03.712968 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-158a594f-c71d-4972-983c-74180ae61691 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:03.713400 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-158a594f-c71d-4972-983c-74180ae61691 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:03.875192 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-158a594f-c71d-4972-983c-74180ae61691 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:03.882725 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-158a594f-c71d-4972-983c-74180ae61691 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1314 microversion: 2.1 time: 0.191500 May 13 17:30:03.883336 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 270/525] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:03 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:03.891233 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-05b8c10d-db63-4712-a656-46951789d65d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:03.897127 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6af74568-2301-416e-9b5d-f8652fffcbee tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:03.897736 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6af74568-2301-416e-9b5d-f8652fffcbee tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:03.899081 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-05b8c10d-db63-4712-a656-46951789d65d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.301529 May 13 17:30:03.899689 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 256/526] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:03 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:03.904017 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ca020c2a-a08f-4904-ad5e-7a405cbba3b2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:03.904254 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6af74568-2301-416e-9b5d-f8652fffcbee tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:03.904610 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ca020c2a-a08f-4904-ad5e-7a405cbba3b2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:03.904713 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6af74568-2301-416e-9b5d-f8652fffcbee tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:03.905475 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6af74568-2301-416e-9b5d-f8652fffcbee tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:03.905913 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6af74568-2301-416e-9b5d-f8652fffcbee tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:03.910956 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ca020c2a-a08f-4904-ad5e-7a405cbba3b2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:03.911489 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ca020c2a-a08f-4904-ad5e-7a405cbba3b2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:03.912200 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ca020c2a-a08f-4904-ad5e-7a405cbba3b2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:03.912628 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ca020c2a-a08f-4904-ad5e-7a405cbba3b2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:03.987636 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6af74568-2301-416e-9b5d-f8652fffcbee tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:04.000110 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6af74568-2301-416e-9b5d-f8652fffcbee tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1301 microversion: 2.1 time: 0.107057 May 13 17:30:04.001969 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 271/527] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:03 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1301 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:04.245008 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ca020c2a-a08f-4904-ad5e-7a405cbba3b2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:04.252324 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ca020c2a-a08f-4904-ad5e-7a405cbba3b2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.351712 May 13 17:30:04.252876 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 257/528] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:03 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:04.557594 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-bb6ce9e1-810a-4418-963e-8498abed0068 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:04.558205 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-bb6ce9e1-810a-4418-963e-8498abed0068 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:04.564571 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bb6ce9e1-810a-4418-963e-8498abed0068 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:04.565022 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bb6ce9e1-810a-4418-963e-8498abed0068 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:04.565793 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bb6ce9e1-810a-4418-963e-8498abed0068 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:04.566898 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bb6ce9e1-810a-4418-963e-8498abed0068 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:04.702130 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-bb6ce9e1-810a-4418-963e-8498abed0068 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:04.708877 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-bb6ce9e1-810a-4418-963e-8498abed0068 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 200 len: 1319 microversion: 2.1 time: 0.155130 May 13 17:30:04.709458 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 272/529] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:04 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:04.898522 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-23228cdb-caba-40f4-992c-4f7ab9ebc929 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:04.899205 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-23228cdb-caba-40f4-992c-4f7ab9ebc929 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:04.905453 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-23228cdb-caba-40f4-992c-4f7ab9ebc929 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:04.905902 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-23228cdb-caba-40f4-992c-4f7ab9ebc929 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:04.906661 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-23228cdb-caba-40f4-992c-4f7ab9ebc929 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:04.907096 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-23228cdb-caba-40f4-992c-4f7ab9ebc929 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:04.916430 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-02fc88ae-279a-4054-a124-9b75e3ee2729 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:04.917043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-02fc88ae-279a-4054-a124-9b75e3ee2729 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:04.923065 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-02fc88ae-279a-4054-a124-9b75e3ee2729 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:04.923587 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-02fc88ae-279a-4054-a124-9b75e3ee2729 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:04.924392 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-02fc88ae-279a-4054-a124-9b75e3ee2729 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:04.924831 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-02fc88ae-279a-4054-a124-9b75e3ee2729 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:05.037033 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-23228cdb-caba-40f4-992c-4f7ab9ebc929 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:05.044237 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-23228cdb-caba-40f4-992c-4f7ab9ebc929 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1314 microversion: 2.1 time: 0.149497 May 13 17:30:05.044808 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 258/530] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:04 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:05.049353 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-559d355b-0a87-4328-9051-d4ee82dcdc85 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:05.050116 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-559d355b-0a87-4328-9051-d4ee82dcdc85 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:05.056621 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-559d355b-0a87-4328-9051-d4ee82dcdc85 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:05.057081 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-559d355b-0a87-4328-9051-d4ee82dcdc85 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:05.057713 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-02fc88ae-279a-4054-a124-9b75e3ee2729 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:05.057871 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-559d355b-0a87-4328-9051-d4ee82dcdc85 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:05.058280 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-559d355b-0a87-4328-9051-d4ee82dcdc85 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:05.065047 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-02fc88ae-279a-4054-a124-9b75e3ee2729 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.152586 May 13 17:30:05.065615 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 273/531] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:04 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:05.117396 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-559d355b-0a87-4328-9051-d4ee82dcdc85 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:05.124586 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-559d355b-0a87-4328-9051-d4ee82dcdc85 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1299 microversion: 2.1 time: 0.078618 May 13 17:30:05.125133 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 259/532] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:05 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1299 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:05.270139 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-5e5676b0-d736-46e8-bb7f-9a30b6676ab1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:05.270751 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-5e5676b0-d736-46e8-bb7f-9a30b6676ab1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:05.276575 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5e5676b0-d736-46e8-bb7f-9a30b6676ab1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:05.277019 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5e5676b0-d736-46e8-bb7f-9a30b6676ab1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:05.277776 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5e5676b0-d736-46e8-bb7f-9a30b6676ab1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:05.278209 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5e5676b0-d736-46e8-bb7f-9a30b6676ab1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:05.413286 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-5e5676b0-d736-46e8-bb7f-9a30b6676ab1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:05.417881 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-5e5676b0-d736-46e8-bb7f-9a30b6676ab1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.152035 May 13 17:30:05.418470 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 274/533] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:05 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:05.705515 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-5432f01f-c717-4785-b224-e9fed9c695ad req-9537d898-a0e9-4e98-9d47-b0a52d561d19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f03ec8a-33aa-483a-af99-ff3925f006a1", "tag": "551049b3-f6c2-479f-9493-4761a2f86f8e"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:30:05.714151 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-5432f01f-c717-4785-b224-e9fed9c695ad req-9537d898-a0e9-4e98-9d47-b0a52d561d19 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:05.714591 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-5432f01f-c717-4785-b224-e9fed9c695ad req-9537d898-a0e9-4e98-9d47-b0a52d561d19 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:05.725813 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a75fea7c-0416-4d09-bae6-40e901f5fa08 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:05.726351 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-5432f01f-c717-4785-b224-e9fed9c695ad req-9537d898-a0e9-4e98-9d47-b0a52d561d19 service nova] Creating event network-changed:551049b3-f6c2-479f-9493-4761a2f86f8e for instance 8f03ec8a-33aa-483a-af99-ff3925f006a1 on hv-cinder-84178 May 13 17:30:05.726489 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a75fea7c-0416-4d09-bae6-40e901f5fa08 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:05.730701 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-5432f01f-c717-4785-b224-e9fed9c695ad req-9537d898-a0e9-4e98-9d47-b0a52d561d19 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028776 May 13 17:30:05.731857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 260/534] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:30:05.733355 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a75fea7c-0416-4d09-bae6-40e901f5fa08 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:05.733809 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a75fea7c-0416-4d09-bae6-40e901f5fa08 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:05.734619 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a75fea7c-0416-4d09-bae6-40e901f5fa08 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:05.735118 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a75fea7c-0416-4d09-bae6-40e901f5fa08 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:05.871809 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a75fea7c-0416-4d09-bae6-40e901f5fa08 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:05.879840 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a75fea7c-0416-4d09-bae6-40e901f5fa08 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 200 len: 1319 microversion: 2.1 time: 0.157729 May 13 17:30:05.883426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 275/535] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:05 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:06.062630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c9101235-b849-4f0c-8e6a-fd5460d683bb tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:06.063389 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c9101235-b849-4f0c-8e6a-fd5460d683bb tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:06.070401 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c9101235-b849-4f0c-8e6a-fd5460d683bb tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:06.070858 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c9101235-b849-4f0c-8e6a-fd5460d683bb tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:06.071693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c9101235-b849-4f0c-8e6a-fd5460d683bb tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:06.072149 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c9101235-b849-4f0c-8e6a-fd5460d683bb tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:06.081868 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-c6cf1c23-5cb3-426a-99c6-aa20e38e8229 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:06.082780 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-c6cf1c23-5cb3-426a-99c6-aa20e38e8229 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:06.089120 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c6cf1c23-5cb3-426a-99c6-aa20e38e8229 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:06.089712 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c6cf1c23-5cb3-426a-99c6-aa20e38e8229 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:06.090752 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c6cf1c23-5cb3-426a-99c6-aa20e38e8229 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:06.091349 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c6cf1c23-5cb3-426a-99c6-aa20e38e8229 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:06.230616 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c6cf1c23-5cb3-426a-99c6-aa20e38e8229 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:06.238538 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-c6cf1c23-5cb3-426a-99c6-aa20e38e8229 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.160146 May 13 17:30:06.239112 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 276/536] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:06 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:06.243495 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-e1d137e9-5063-4ec9-afd2-4dad62eac1e6 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:06.247756 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-e1d137e9-5063-4ec9-afd2-4dad62eac1e6 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:06.250342 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e1d137e9-5063-4ec9-afd2-4dad62eac1e6 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:06.250869 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e1d137e9-5063-4ec9-afd2-4dad62eac1e6 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:06.251859 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e1d137e9-5063-4ec9-afd2-4dad62eac1e6 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:06.252511 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e1d137e9-5063-4ec9-afd2-4dad62eac1e6 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:06.320165 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-e1d137e9-5063-4ec9-afd2-4dad62eac1e6 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:06.327582 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-e1d137e9-5063-4ec9-afd2-4dad62eac1e6 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1299 microversion: 2.1 time: 0.087429 May 13 17:30:06.328164 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 277/537] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:06 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:06.328448 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c9101235-b849-4f0c-8e6a-fd5460d683bb tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:06.336124 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c9101235-b849-4f0c-8e6a-fd5460d683bb tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1498 microversion: 2.1 time: 0.278239 May 13 17:30:06.336895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 261/538] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:06 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1498 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:06.434406 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b97bf40d-4c7a-4f38-a0ad-a4d9c9b9df80 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:06.435038 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b97bf40d-4c7a-4f38-a0ad-a4d9c9b9df80 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:06.441542 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b97bf40d-4c7a-4f38-a0ad-a4d9c9b9df80 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:06.441542 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b97bf40d-4c7a-4f38-a0ad-a4d9c9b9df80 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:06.442370 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b97bf40d-4c7a-4f38-a0ad-a4d9c9b9df80 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:06.442857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b97bf40d-4c7a-4f38-a0ad-a4d9c9b9df80 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:06.607745 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b97bf40d-4c7a-4f38-a0ad-a4d9c9b9df80 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:06.617045 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b97bf40d-4c7a-4f38-a0ad-a4d9c9b9df80 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.186737 May 13 17:30:06.617633 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 278/539] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:06 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:06.905893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e79e3a5a-e359-4117-a509-5f75629aa93e tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:06.906519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e79e3a5a-e359-4117-a509-5f75629aa93e tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:06.917098 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e79e3a5a-e359-4117-a509-5f75629aa93e tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:06.917629 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e79e3a5a-e359-4117-a509-5f75629aa93e tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:06.918426 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e79e3a5a-e359-4117-a509-5f75629aa93e tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:06.922612 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e79e3a5a-e359-4117-a509-5f75629aa93e tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:07.206275 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e79e3a5a-e359-4117-a509-5f75629aa93e tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:07.214507 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e79e3a5a-e359-4117-a509-5f75629aa93e tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 200 len: 1319 microversion: 2.1 time: 0.316742 May 13 17:30:07.215093 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 262/540] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:06 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 1319 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:07.265366 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a058b9ad-5d3a-401d-be81-0ed298cf3780 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:07.265366 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a058b9ad-5d3a-401d-be81-0ed298cf3780 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:07.274830 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a058b9ad-5d3a-401d-be81-0ed298cf3780 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:07.275322 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a058b9ad-5d3a-401d-be81-0ed298cf3780 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:07.276693 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a058b9ad-5d3a-401d-be81-0ed298cf3780 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:07.277140 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a058b9ad-5d3a-401d-be81-0ed298cf3780 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:07.348592 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-042f95d9-d71b-444c-95f2-dfa84163ad4e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:07.349490 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-042f95d9-d71b-444c-95f2-dfa84163ad4e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:07.355878 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-042f95d9-d71b-444c-95f2-dfa84163ad4e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:07.356441 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-042f95d9-d71b-444c-95f2-dfa84163ad4e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:07.357094 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-042f95d9-d71b-444c-95f2-dfa84163ad4e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:07.357577 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-042f95d9-d71b-444c-95f2-dfa84163ad4e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:07.425063 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a058b9ad-5d3a-401d-be81-0ed298cf3780 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:07.433313 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a058b9ad-5d3a-401d-be81-0ed298cf3780 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.174460 May 13 17:30:07.433977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 279/541] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:07 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:07.456675 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-81000bc3-74c9-4433-9e53-926b3900af22 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:07.456675 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-81000bc3-74c9-4433-9e53-926b3900af22 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:07.461268 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-81000bc3-74c9-4433-9e53-926b3900af22 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:07.461709 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-81000bc3-74c9-4433-9e53-926b3900af22 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:07.462546 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-81000bc3-74c9-4433-9e53-926b3900af22 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:07.462978 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-81000bc3-74c9-4433-9e53-926b3900af22 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:07.487747 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-81000bc3-74c9-4433-9e53-926b3900af22 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Going to try to terminate instance {{(pid=117492) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 17:30:07.515552 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-042f95d9-d71b-444c-95f2-dfa84163ad4e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:07.528857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-042f95d9-d71b-444c-95f2-dfa84163ad4e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.184591 May 13 17:30:07.529444 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 263/542] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:07 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:07.634186 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2e051d84-bf07-4128-9e69-6faab913d2e0 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:07.637769 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2e051d84-bf07-4128-9e69-6faab913d2e0 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:07.646192 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2e051d84-bf07-4128-9e69-6faab913d2e0 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:07.646192 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2e051d84-bf07-4128-9e69-6faab913d2e0 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:07.646376 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2e051d84-bf07-4128-9e69-6faab913d2e0 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:07.646704 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2e051d84-bf07-4128-9e69-6faab913d2e0 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:07.817628 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2e051d84-bf07-4128-9e69-6faab913d2e0 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:07.824904 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2e051d84-bf07-4128-9e69-6faab913d2e0 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.194542 May 13 17:30:07.825472 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 264/543] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:07 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:07.888030 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-81000bc3-74c9-4433-9e53-926b3900af22 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "DELETE /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 204 len: 0 microversion: 2.1 time: 0.436866 May 13 17:30:07.890630 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 280/544] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:30:07 2022] DELETE /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 13 17:30:07.896667 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-68b474b7-1c5a-48de-b1ea-2f1f21522672 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:07.897323 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-68b474b7-1c5a-48de-b1ea-2f1f21522672 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:07.903269 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-68b474b7-1c5a-48de-b1ea-2f1f21522672 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:07.903732 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-68b474b7-1c5a-48de-b1ea-2f1f21522672 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:07.904505 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-68b474b7-1c5a-48de-b1ea-2f1f21522672 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:07.904944 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-68b474b7-1c5a-48de-b1ea-2f1f21522672 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:07.951820 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-a750df8d-5527-4b85-bfad-ea18116fc75f req-cf06d65d-7ade-4f06-aa6f-30e038682203 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2", "tag": "59800603-642e-4f31-b41b-ffa2355488f5"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:30:07.965674 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-a750df8d-5527-4b85-bfad-ea18116fc75f req-cf06d65d-7ade-4f06-aa6f-30e038682203 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:07.966042 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-a750df8d-5527-4b85-bfad-ea18116fc75f req-cf06d65d-7ade-4f06-aa6f-30e038682203 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:07.981524 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-a750df8d-5527-4b85-bfad-ea18116fc75f req-cf06d65d-7ade-4f06-aa6f-30e038682203 service nova] Creating event network-changed:59800603-642e-4f31-b41b-ffa2355488f5 for instance 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 on hv-cinder-84178 May 13 17:30:07.986963 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-a750df8d-5527-4b85-bfad-ea18116fc75f req-cf06d65d-7ade-4f06-aa6f-30e038682203 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040739 May 13 17:30:07.988024 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 281/545] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:30:08.074384 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-68b474b7-1c5a-48de-b1ea-2f1f21522672 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:08.082850 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-68b474b7-1c5a-48de-b1ea-2f1f21522672 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1504 microversion: 2.1 time: 0.189830 May 13 17:30:08.083545 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 265/546] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:07 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1504 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:08.232918 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f1623129-0c7a-4dd3-b322-ba2f765f88b3 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:08.233536 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-f1623129-0c7a-4dd3-b322-ba2f765f88b3 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:08.239692 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f1623129-0c7a-4dd3-b322-ba2f765f88b3 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:08.240147 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f1623129-0c7a-4dd3-b322-ba2f765f88b3 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:08.240914 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f1623129-0c7a-4dd3-b322-ba2f765f88b3 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:08.241352 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f1623129-0c7a-4dd3-b322-ba2f765f88b3 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:08.380938 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f1623129-0c7a-4dd3-b322-ba2f765f88b3 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:08.388404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f1623129-0c7a-4dd3-b322-ba2f765f88b3 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 200 len: 1319 microversion: 2.1 time: 0.159817 May 13 17:30:08.388972 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 282/547] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:08 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:08.449860 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-61f0a14c-b44e-408f-9b05-8d87ef46e601 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:08.450497 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-61f0a14c-b44e-408f-9b05-8d87ef46e601 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:08.456415 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61f0a14c-b44e-408f-9b05-8d87ef46e601 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:08.457381 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61f0a14c-b44e-408f-9b05-8d87ef46e601 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:08.458145 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61f0a14c-b44e-408f-9b05-8d87ef46e601 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:08.458585 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61f0a14c-b44e-408f-9b05-8d87ef46e601 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:08.545548 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-4c98731c-90bf-4756-9855-e89591d331c4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:08.546160 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-4c98731c-90bf-4756-9855-e89591d331c4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:08.552077 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4c98731c-90bf-4756-9855-e89591d331c4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:08.552536 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4c98731c-90bf-4756-9855-e89591d331c4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:08.553307 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4c98731c-90bf-4756-9855-e89591d331c4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:08.553744 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4c98731c-90bf-4756-9855-e89591d331c4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:08.586494 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-61f0a14c-b44e-408f-9b05-8d87ef46e601 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:08.595096 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-61f0a14c-b44e-408f-9b05-8d87ef46e601 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.149016 May 13 17:30:08.595953 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 266/548] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:08 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:08.684597 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-4c98731c-90bf-4756-9855-e89591d331c4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:08.692324 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-4c98731c-90bf-4756-9855-e89591d331c4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.150474 May 13 17:30:08.693220 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 283/549] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:08 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:08.841389 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5910f55e-80c0-4da5-9bb2-223b9f78228e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:08.841921 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5910f55e-80c0-4da5-9bb2-223b9f78228e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:08.848051 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5910f55e-80c0-4da5-9bb2-223b9f78228e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:08.848496 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5910f55e-80c0-4da5-9bb2-223b9f78228e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:08.849249 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5910f55e-80c0-4da5-9bb2-223b9f78228e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:08.849687 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5910f55e-80c0-4da5-9bb2-223b9f78228e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:08.977450 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5910f55e-80c0-4da5-9bb2-223b9f78228e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:08.984605 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5910f55e-80c0-4da5-9bb2-223b9f78228e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.147143 May 13 17:30:08.985197 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 267/550] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:08 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:09.101020 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b97540d9-5be1-4ddb-9836-2f0500fdee19 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:09.101550 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b97540d9-5be1-4ddb-9836-2f0500fdee19 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:09.107449 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b97540d9-5be1-4ddb-9836-2f0500fdee19 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:09.107898 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b97540d9-5be1-4ddb-9836-2f0500fdee19 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:09.108689 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b97540d9-5be1-4ddb-9836-2f0500fdee19 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:09.109126 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b97540d9-5be1-4ddb-9836-2f0500fdee19 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:09.233426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b97540d9-5be1-4ddb-9836-2f0500fdee19 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:09.241364 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b97540d9-5be1-4ddb-9836-2f0500fdee19 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1504 microversion: 2.1 time: 0.144883 May 13 17:30:09.241941 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 284/551] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:09 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1504 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:09.405696 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f570b9e8-499a-4136-826f-c283ba91972e tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:09.406305 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f570b9e8-499a-4136-826f-c283ba91972e tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:09.412637 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f570b9e8-499a-4136-826f-c283ba91972e tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:09.413089 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f570b9e8-499a-4136-826f-c283ba91972e tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:09.413848 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f570b9e8-499a-4136-826f-c283ba91972e tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:09.414283 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f570b9e8-499a-4136-826f-c283ba91972e tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:09.551277 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f570b9e8-499a-4136-826f-c283ba91972e tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:09.558891 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f570b9e8-499a-4136-826f-c283ba91972e tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 200 len: 1319 microversion: 2.1 time: 0.156952 May 13 17:30:09.559479 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 268/552] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:09 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:09.611988 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3af5858e-4274-410e-8b1b-f4e068f3f7f0 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:09.612597 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3af5858e-4274-410e-8b1b-f4e068f3f7f0 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:09.619002 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3af5858e-4274-410e-8b1b-f4e068f3f7f0 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:09.619488 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3af5858e-4274-410e-8b1b-f4e068f3f7f0 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:09.620247 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3af5858e-4274-410e-8b1b-f4e068f3f7f0 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:09.620680 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3af5858e-4274-410e-8b1b-f4e068f3f7f0 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:09.709486 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6889c6c1-10ae-4581-9b73-575320ea3fd3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:09.710097 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6889c6c1-10ae-4581-9b73-575320ea3fd3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:09.716400 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6889c6c1-10ae-4581-9b73-575320ea3fd3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:09.716853 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6889c6c1-10ae-4581-9b73-575320ea3fd3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:09.717633 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6889c6c1-10ae-4581-9b73-575320ea3fd3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:09.718074 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6889c6c1-10ae-4581-9b73-575320ea3fd3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:09.751664 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3af5858e-4274-410e-8b1b-f4e068f3f7f0 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:09.758938 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3af5858e-4274-410e-8b1b-f4e068f3f7f0 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.150678 May 13 17:30:09.759560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 285/553] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:09 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:09.845979 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6889c6c1-10ae-4581-9b73-575320ea3fd3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:09.853633 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6889c6c1-10ae-4581-9b73-575320ea3fd3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.148562 May 13 17:30:09.854201 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 269/554] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:09 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:10.001647 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-09c3c76d-b085-4618-8682-16fe126063c9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:10.002249 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-09c3c76d-b085-4618-8682-16fe126063c9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:10.008700 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-09c3c76d-b085-4618-8682-16fe126063c9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:10.009148 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-09c3c76d-b085-4618-8682-16fe126063c9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:10.009905 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-09c3c76d-b085-4618-8682-16fe126063c9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:10.010336 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-09c3c76d-b085-4618-8682-16fe126063c9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:10.135530 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-09c3c76d-b085-4618-8682-16fe126063c9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:10.142819 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-09c3c76d-b085-4618-8682-16fe126063c9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.144923 May 13 17:30:10.143426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 286/555] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:09 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:10.258632 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b21e9790-b76c-4699-8fa6-c1753ec09157 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:10.259263 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b21e9790-b76c-4699-8fa6-c1753ec09157 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:10.265079 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b21e9790-b76c-4699-8fa6-c1753ec09157 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:10.265529 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b21e9790-b76c-4699-8fa6-c1753ec09157 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:10.266296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b21e9790-b76c-4699-8fa6-c1753ec09157 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:10.266732 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b21e9790-b76c-4699-8fa6-c1753ec09157 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:10.498962 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b21e9790-b76c-4699-8fa6-c1753ec09157 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:10.506829 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b21e9790-b76c-4699-8fa6-c1753ec09157 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1504 microversion: 2.1 time: 0.252078 May 13 17:30:10.507431 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 270/556] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:10 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1504 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:10.574730 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-64f2e02a-e153-4e14-9e04-3f476f31d3f2 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:10.575309 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-64f2e02a-e153-4e14-9e04-3f476f31d3f2 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:10.581483 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-64f2e02a-e153-4e14-9e04-3f476f31d3f2 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:10.581979 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-64f2e02a-e153-4e14-9e04-3f476f31d3f2 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:10.582759 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-64f2e02a-e153-4e14-9e04-3f476f31d3f2 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:10.583274 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-64f2e02a-e153-4e14-9e04-3f476f31d3f2 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:10.715466 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-64f2e02a-e153-4e14-9e04-3f476f31d3f2 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:10.723506 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-64f2e02a-e153-4e14-9e04-3f476f31d3f2 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 200 len: 1319 microversion: 2.1 time: 0.152649 May 13 17:30:10.724083 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 287/557] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:10 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:10.775358 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b55a1597-253d-4806-93ee-0a2487d392ec tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:10.775970 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b55a1597-253d-4806-93ee-0a2487d392ec tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:10.782241 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b55a1597-253d-4806-93ee-0a2487d392ec tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:10.782726 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b55a1597-253d-4806-93ee-0a2487d392ec tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:10.783568 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b55a1597-253d-4806-93ee-0a2487d392ec tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:10.784013 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b55a1597-253d-4806-93ee-0a2487d392ec tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:10.871558 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-790079e0-80c5-421d-82f8-dbba7b946e9f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:10.872314 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-790079e0-80c5-421d-82f8-dbba7b946e9f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:10.888226 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-790079e0-80c5-421d-82f8-dbba7b946e9f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:10.889764 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-790079e0-80c5-421d-82f8-dbba7b946e9f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:10.890572 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-790079e0-80c5-421d-82f8-dbba7b946e9f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:10.891012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-790079e0-80c5-421d-82f8-dbba7b946e9f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:10.955648 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b55a1597-253d-4806-93ee-0a2487d392ec tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:10.965360 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b55a1597-253d-4806-93ee-0a2487d392ec tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.193650 May 13 17:30:10.968707 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 271/558] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:10 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:11.033980 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-790079e0-80c5-421d-82f8-dbba7b946e9f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:11.041893 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-790079e0-80c5-421d-82f8-dbba7b946e9f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.174807 May 13 17:30:11.042460 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 288/559] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:10 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:11.160856 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-208f0822-caa6-4a77-9b92-45b358a745fe tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:11.161463 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-208f0822-caa6-4a77-9b92-45b358a745fe tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:11.167748 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-208f0822-caa6-4a77-9b92-45b358a745fe tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:11.175418 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-208f0822-caa6-4a77-9b92-45b358a745fe tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:11.175418 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-208f0822-caa6-4a77-9b92-45b358a745fe tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:11.175418 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-208f0822-caa6-4a77-9b92-45b358a745fe tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:11.296095 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-208f0822-caa6-4a77-9b92-45b358a745fe tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:11.303497 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-208f0822-caa6-4a77-9b92-45b358a745fe tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.147017 May 13 17:30:11.304062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 272/560] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:11 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:11.524513 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1405a8dc-e2a4-4217-b871-dd8357814a2d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:11.525126 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-1405a8dc-e2a4-4217-b871-dd8357814a2d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:11.531156 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1405a8dc-e2a4-4217-b871-dd8357814a2d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:11.531622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1405a8dc-e2a4-4217-b871-dd8357814a2d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:11.532398 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1405a8dc-e2a4-4217-b871-dd8357814a2d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:11.532834 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1405a8dc-e2a4-4217-b871-dd8357814a2d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:11.666039 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-1405a8dc-e2a4-4217-b871-dd8357814a2d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:11.673343 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-1405a8dc-e2a4-4217-b871-dd8357814a2d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1504 microversion: 2.1 time: 0.152639 May 13 17:30:11.673900 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 289/561] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:11 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:11.740242 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-331fb820-63eb-455f-804f-9ad52ab161c0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:11.740803 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-331fb820-63eb-455f-804f-9ad52ab161c0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:11.746825 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-331fb820-63eb-455f-804f-9ad52ab161c0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:11.747302 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-331fb820-63eb-455f-804f-9ad52ab161c0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:11.748168 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-331fb820-63eb-455f-804f-9ad52ab161c0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:11.748521 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-331fb820-63eb-455f-804f-9ad52ab161c0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:11.876727 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-331fb820-63eb-455f-804f-9ad52ab161c0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:11.884773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-331fb820-63eb-455f-804f-9ad52ab161c0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 200 len: 1319 microversion: 2.1 time: 0.148499 May 13 17:30:11.885816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 273/562] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:11 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:11.983318 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-447f1e17-ec05-40eb-927d-12dd02d04ecc tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:11.983930 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-447f1e17-ec05-40eb-927d-12dd02d04ecc tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:11.991340 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-447f1e17-ec05-40eb-927d-12dd02d04ecc tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:11.991340 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-447f1e17-ec05-40eb-927d-12dd02d04ecc tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:11.991817 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-447f1e17-ec05-40eb-927d-12dd02d04ecc tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:11.992218 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-447f1e17-ec05-40eb-927d-12dd02d04ecc tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:12.059253 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-95e02004-d720-4716-aff3-f72e7e6b25c6 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:12.059863 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-95e02004-d720-4716-aff3-f72e7e6b25c6 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:12.066760 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-95e02004-d720-4716-aff3-f72e7e6b25c6 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:12.067240 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-95e02004-d720-4716-aff3-f72e7e6b25c6 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:12.068208 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-95e02004-d720-4716-aff3-f72e7e6b25c6 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:12.069176 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-95e02004-d720-4716-aff3-f72e7e6b25c6 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:12.154328 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-447f1e17-ec05-40eb-927d-12dd02d04ecc tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:12.165514 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-447f1e17-ec05-40eb-927d-12dd02d04ecc tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.185703 May 13 17:30:12.168723 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 290/563] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:11 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:12.231048 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-95e02004-d720-4716-aff3-f72e7e6b25c6 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:12.238514 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-95e02004-d720-4716-aff3-f72e7e6b25c6 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.183012 May 13 17:30:12.239212 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 274/564] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:12 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:12.320670 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-e7506bf0-9118-4e37-a72a-b3fafa611d79 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:12.321204 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-e7506bf0-9118-4e37-a72a-b3fafa611d79 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:12.327089 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e7506bf0-9118-4e37-a72a-b3fafa611d79 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:12.329386 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e7506bf0-9118-4e37-a72a-b3fafa611d79 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:12.330234 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e7506bf0-9118-4e37-a72a-b3fafa611d79 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:12.330683 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e7506bf0-9118-4e37-a72a-b3fafa611d79 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:12.462897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-e7506bf0-9118-4e37-a72a-b3fafa611d79 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:12.470251 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-e7506bf0-9118-4e37-a72a-b3fafa611d79 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.153964 May 13 17:30:12.471072 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 291/565] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:12 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:12.689896 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3033cfff-eba9-4268-96ea-99d3462b89d8 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:12.690531 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3033cfff-eba9-4268-96ea-99d3462b89d8 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:12.697270 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3033cfff-eba9-4268-96ea-99d3462b89d8 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:12.697716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3033cfff-eba9-4268-96ea-99d3462b89d8 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:12.698478 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3033cfff-eba9-4268-96ea-99d3462b89d8 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:12.698915 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3033cfff-eba9-4268-96ea-99d3462b89d8 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:12.764841 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 17:30:12.765076 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Fri May 13 17:30:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 17:30:12.832178 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3033cfff-eba9-4268-96ea-99d3462b89d8 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:12.839547 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3033cfff-eba9-4268-96ea-99d3462b89d8 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1504 microversion: 2.1 time: 0.153412 May 13 17:30:12.840331 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 275/566] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:12 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:12.900532 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d067a1a7-c727-4eb1-98ce-692f6655ef37 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:12.901095 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d067a1a7-c727-4eb1-98ce-692f6655ef37 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:12.908219 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d067a1a7-c727-4eb1-98ce-692f6655ef37 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:12.908704 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d067a1a7-c727-4eb1-98ce-692f6655ef37 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:12.909470 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d067a1a7-c727-4eb1-98ce-692f6655ef37 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:12.909941 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d067a1a7-c727-4eb1-98ce-692f6655ef37 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:13.043304 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d067a1a7-c727-4eb1-98ce-692f6655ef37 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:13.051591 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d067a1a7-c727-4eb1-98ce-692f6655ef37 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 200 len: 1319 microversion: 2.1 time: 0.154161 May 13 17:30:13.052327 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 292/567] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:12 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:13.182304 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7c3150f4-c46c-4841-b707-42d04eee1c6b tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:13.182863 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7c3150f4-c46c-4841-b707-42d04eee1c6b tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:13.191449 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7c3150f4-c46c-4841-b707-42d04eee1c6b tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:13.191889 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7c3150f4-c46c-4841-b707-42d04eee1c6b tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:13.192660 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7c3150f4-c46c-4841-b707-42d04eee1c6b tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:13.193095 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7c3150f4-c46c-4841-b707-42d04eee1c6b tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:13.194704 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-62f10428-8159-47d3-a282-9e4431fb4d8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:13.195305 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-62f10428-8159-47d3-a282-9e4431fb4d8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:13.201419 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-62f10428-8159-47d3-a282-9e4431fb4d8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:13.201945 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-62f10428-8159-47d3-a282-9e4431fb4d8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:13.202785 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-62f10428-8159-47d3-a282-9e4431fb4d8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:13.203344 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-62f10428-8159-47d3-a282-9e4431fb4d8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:13.227198 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-62f10428-8159-47d3-a282-9e4431fb4d8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67/ips" status: 200 len: 151 microversion: 2.20 time: 0.036718 May 13 17:30:13.228229 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 293/568] 10.222.0.64 () {60 vars in 1288 bytes} [Fri May 13 17:30:13 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 17:30:13.258704 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-54d9fad4-477c-45dc-b4a8-b9fe3453c0be tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:13.259952 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-54d9fad4-477c-45dc-b4a8-b9fe3453c0be tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:13.266483 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-54d9fad4-477c-45dc-b4a8-b9fe3453c0be tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:13.267013 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-54d9fad4-477c-45dc-b4a8-b9fe3453c0be tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:13.267879 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-54d9fad4-477c-45dc-b4a8-b9fe3453c0be tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:13.268401 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-54d9fad4-477c-45dc-b4a8-b9fe3453c0be tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:13.363442 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7c3150f4-c46c-4841-b707-42d04eee1c6b tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:13.372631 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7c3150f4-c46c-4841-b707-42d04eee1c6b tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.194081 May 13 17:30:13.373555 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 276/569] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:13 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:13.443176 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-54d9fad4-477c-45dc-b4a8-b9fe3453c0be tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:13.450619 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-54d9fad4-477c-45dc-b4a8-b9fe3453c0be tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.199224 May 13 17:30:13.459548 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 294/570] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:13 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:13.487224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a5a2b46f-711e-4f50-a062-f436c253cb68 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:13.488387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a5a2b46f-711e-4f50-a062-f436c253cb68 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:13.494351 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a5a2b46f-711e-4f50-a062-f436c253cb68 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:13.494827 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a5a2b46f-711e-4f50-a062-f436c253cb68 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:13.495609 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a5a2b46f-711e-4f50-a062-f436c253cb68 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:13.496098 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a5a2b46f-711e-4f50-a062-f436c253cb68 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:13.564874 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-64b04333-edfb-4aa4-8d05-8d89569fb75b req-96e078d9-925d-4a5e-9688-25057b1b409a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f03ec8a-33aa-483a-af99-ff3925f006a1", "name": "network-vif-plugged", "status": "completed", "tag": "551049b3-f6c2-479f-9493-4761a2f86f8e"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:30:13.581425 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-64b04333-edfb-4aa4-8d05-8d89569fb75b req-96e078d9-925d-4a5e-9688-25057b1b409a service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:13.583328 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-64b04333-edfb-4aa4-8d05-8d89569fb75b req-96e078d9-925d-4a5e-9688-25057b1b409a service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:13.595347 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-64b04333-edfb-4aa4-8d05-8d89569fb75b req-96e078d9-925d-4a5e-9688-25057b1b409a service nova] Creating event network-vif-plugged:551049b3-f6c2-479f-9493-4761a2f86f8e for instance 8f03ec8a-33aa-483a-af99-ff3925f006a1 on hv-cinder-84178 May 13 17:30:13.601271 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-64b04333-edfb-4aa4-8d05-8d89569fb75b req-96e078d9-925d-4a5e-9688-25057b1b409a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044552 May 13 17:30:13.607860 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 295/571] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:30:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:30:13.636250 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a5a2b46f-711e-4f50-a062-f436c253cb68 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:13.643438 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a5a2b46f-711e-4f50-a062-f436c253cb68 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.160238 May 13 17:30:13.643993 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 277/572] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:13 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:13.860549 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-e0d9c8c3-e762-45d2-9255-c0e59226ebf1 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:13.864024 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-e0d9c8c3-e762-45d2-9255-c0e59226ebf1 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:13.868495 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e0d9c8c3-e762-45d2-9255-c0e59226ebf1 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:13.869021 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e0d9c8c3-e762-45d2-9255-c0e59226ebf1 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:13.869932 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e0d9c8c3-e762-45d2-9255-c0e59226ebf1 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:13.870501 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e0d9c8c3-e762-45d2-9255-c0e59226ebf1 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:14.006904 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-e0d9c8c3-e762-45d2-9255-c0e59226ebf1 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:14.014346 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-e0d9c8c3-e762-45d2-9255-c0e59226ebf1 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1504 microversion: 2.1 time: 0.159235 May 13 17:30:14.014924 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 296/573] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:13 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:14.069058 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ae51ae17-6c0a-44eb-94a7-6b484d436289 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:14.069668 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ae51ae17-6c0a-44eb-94a7-6b484d436289 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:14.076094 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ae51ae17-6c0a-44eb-94a7-6b484d436289 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:14.076549 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ae51ae17-6c0a-44eb-94a7-6b484d436289 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:14.077316 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ae51ae17-6c0a-44eb-94a7-6b484d436289 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:14.077756 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ae51ae17-6c0a-44eb-94a7-6b484d436289 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:14.243256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ae51ae17-6c0a-44eb-94a7-6b484d436289 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:14.250624 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ae51ae17-6c0a-44eb-94a7-6b484d436289 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 200 len: 1319 microversion: 2.1 time: 0.185709 May 13 17:30:14.251212 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 278/574] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:14 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:14.389213 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-44e065e5-327b-4ff0-9863-a28efc7538e5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:14.389810 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-44e065e5-327b-4ff0-9863-a28efc7538e5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:14.396246 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-44e065e5-327b-4ff0-9863-a28efc7538e5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:14.396722 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-44e065e5-327b-4ff0-9863-a28efc7538e5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:14.397472 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-44e065e5-327b-4ff0-9863-a28efc7538e5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:14.397904 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-44e065e5-327b-4ff0-9863-a28efc7538e5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:14.467344 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-56b586d6-9dca-44a0-83b4-0c03a0bd3ebb tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:14.467879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-56b586d6-9dca-44a0-83b4-0c03a0bd3ebb tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:14.474555 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-56b586d6-9dca-44a0-83b4-0c03a0bd3ebb tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:14.475010 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-56b586d6-9dca-44a0-83b4-0c03a0bd3ebb tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:14.475811 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-56b586d6-9dca-44a0-83b4-0c03a0bd3ebb tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:14.476451 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-56b586d6-9dca-44a0-83b4-0c03a0bd3ebb tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:14.533185 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-44e065e5-327b-4ff0-9863-a28efc7538e5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:14.544232 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-44e065e5-327b-4ff0-9863-a28efc7538e5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.158787 May 13 17:30:14.545000 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 297/575] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:14 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:14.605037 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-56b586d6-9dca-44a0-83b4-0c03a0bd3ebb tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:14.612291 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-56b586d6-9dca-44a0-83b4-0c03a0bd3ebb tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.148873 May 13 17:30:14.613515 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 279/576] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:14 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:14.665626 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-91ffda2c-62bc-4aa4-81a7-77c7bd8736f5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:14.666852 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-91ffda2c-62bc-4aa4-81a7-77c7bd8736f5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:14.674067 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-91ffda2c-62bc-4aa4-81a7-77c7bd8736f5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:14.674599 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-91ffda2c-62bc-4aa4-81a7-77c7bd8736f5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:14.676010 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-91ffda2c-62bc-4aa4-81a7-77c7bd8736f5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:14.676455 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-91ffda2c-62bc-4aa4-81a7-77c7bd8736f5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:14.818552 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-91ffda2c-62bc-4aa4-81a7-77c7bd8736f5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:14.826828 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-91ffda2c-62bc-4aa4-81a7-77c7bd8736f5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.169151 May 13 17:30:14.827822 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 298/577] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:14 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:15.030900 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-35feafd0-010c-4a8a-b438-24f69ed3996d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:15.031537 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-35feafd0-010c-4a8a-b438-24f69ed3996d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:15.038238 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-35feafd0-010c-4a8a-b438-24f69ed3996d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:15.038751 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-35feafd0-010c-4a8a-b438-24f69ed3996d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:15.039559 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-35feafd0-010c-4a8a-b438-24f69ed3996d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:15.039992 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-35feafd0-010c-4a8a-b438-24f69ed3996d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:15.266946 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-e551edf8-156c-4fce-99fa-b880a10928bf tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:15.267581 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-e551edf8-156c-4fce-99fa-b880a10928bf tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:15.274715 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e551edf8-156c-4fce-99fa-b880a10928bf tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:15.275292 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e551edf8-156c-4fce-99fa-b880a10928bf tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:15.276036 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e551edf8-156c-4fce-99fa-b880a10928bf tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:15.276466 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e551edf8-156c-4fce-99fa-b880a10928bf tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:15.320188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-35feafd0-010c-4a8a-b438-24f69ed3996d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:15.328866 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-35feafd0-010c-4a8a-b438-24f69ed3996d tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1504 microversion: 2.1 time: 0.301861 May 13 17:30:15.336299 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 280/578] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:15 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1504 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:15.406241 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-e551edf8-156c-4fce-99fa-b880a10928bf tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:15.413649 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-e551edf8-156c-4fce-99fa-b880a10928bf tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 200 len: 1319 microversion: 2.1 time: 0.150548 May 13 17:30:15.418033 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 299/579] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:15 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:15.562433 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-255d0417-6f22-4448-bf08-e463425d8c68 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:15.563083 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-255d0417-6f22-4448-bf08-e463425d8c68 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:15.570078 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-255d0417-6f22-4448-bf08-e463425d8c68 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:15.570738 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-255d0417-6f22-4448-bf08-e463425d8c68 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:15.571739 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-255d0417-6f22-4448-bf08-e463425d8c68 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:15.572213 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-255d0417-6f22-4448-bf08-e463425d8c68 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:15.609463 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-c0f54809-eeb9-4d25-a473-5d1150900336 req-a332812c-4a1c-4f1d-b807-6878088482ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "686847ed-a4cd-42fe-ae51-44ce52cf1ae4", "name": "network-vif-deleted", "tag": "c62b5b29-b80a-46ee-971c-66d386497347"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:30:15.621630 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-c0f54809-eeb9-4d25-a473-5d1150900336 req-a332812c-4a1c-4f1d-b807-6878088482ac service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:15.622088 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-c0f54809-eeb9-4d25-a473-5d1150900336 req-a332812c-4a1c-4f1d-b807-6878088482ac service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:15.634176 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-c0f54809-eeb9-4d25-a473-5d1150900336 req-a332812c-4a1c-4f1d-b807-6878088482ac service nova] Creating event network-vif-deleted:c62b5b29-b80a-46ee-971c-66d386497347 for instance 686847ed-a4cd-42fe-ae51-44ce52cf1ae4 on hv-cinder-84178 May 13 17:30:15.639395 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-c0f54809-eeb9-4d25-a473-5d1150900336 req-a332812c-4a1c-4f1d-b807-6878088482ac service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035076 May 13 17:30:15.640267 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 300/580] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:30:15.648008 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-e6ca8d78-d231-4e3e-832f-2311676b0a7d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:15.648008 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-e6ca8d78-d231-4e3e-832f-2311676b0a7d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:15.653140 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e6ca8d78-d231-4e3e-832f-2311676b0a7d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:15.653661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e6ca8d78-d231-4e3e-832f-2311676b0a7d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:15.654486 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e6ca8d78-d231-4e3e-832f-2311676b0a7d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:15.655321 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e6ca8d78-d231-4e3e-832f-2311676b0a7d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:15.813151 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-255d0417-6f22-4448-bf08-e463425d8c68 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:15.814566 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-e6ca8d78-d231-4e3e-832f-2311676b0a7d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:15.821321 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-255d0417-6f22-4448-bf08-e463425d8c68 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.263293 May 13 17:30:15.822115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 281/581] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:15 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:15.831416 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-e6ca8d78-d231-4e3e-832f-2311676b0a7d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.189777 May 13 17:30:15.832028 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 301/582] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:15 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:15.846900 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1bee588b-3951-433d-acbe-41c7eb9cb2df tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:15.847574 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1bee588b-3951-433d-acbe-41c7eb9cb2df tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:15.848904 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-85e8e35c-584a-4d3c-91e5-1e69d6fee128 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:15.849514 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-85e8e35c-584a-4d3c-91e5-1e69d6fee128 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:15.853575 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1bee588b-3951-433d-acbe-41c7eb9cb2df tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:15.854034 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1bee588b-3951-433d-acbe-41c7eb9cb2df tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:15.854802 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1bee588b-3951-433d-acbe-41c7eb9cb2df tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:15.855267 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1bee588b-3951-433d-acbe-41c7eb9cb2df tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:15.855386 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-85e8e35c-584a-4d3c-91e5-1e69d6fee128 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:15.855760 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-85e8e35c-584a-4d3c-91e5-1e69d6fee128 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:15.856523 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-85e8e35c-584a-4d3c-91e5-1e69d6fee128 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:15.857136 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-85e8e35c-584a-4d3c-91e5-1e69d6fee128 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:15.989943 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-85e8e35c-584a-4d3c-91e5-1e69d6fee128 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:16.000386 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-85e8e35c-584a-4d3c-91e5-1e69d6fee128 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1595 microversion: 2.1 time: 0.155301 May 13 17:30:16.001155 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 302/583] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:15 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1595 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:16.230869 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1bee588b-3951-433d-acbe-41c7eb9cb2df tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:16.238998 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1bee588b-3951-433d-acbe-41c7eb9cb2df tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.396063 May 13 17:30:16.239595 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 282/584] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:15 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:16.351268 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b1c93325-bfa6-443d-930c-63d4ba49b4cf tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:16.352166 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b1c93325-bfa6-443d-930c-63d4ba49b4cf tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:16.358369 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b1c93325-bfa6-443d-930c-63d4ba49b4cf tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:16.358897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b1c93325-bfa6-443d-930c-63d4ba49b4cf tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:16.359948 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b1c93325-bfa6-443d-930c-63d4ba49b4cf tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:16.360525 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b1c93325-bfa6-443d-930c-63d4ba49b4cf tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:16.413719 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-18160b2c-e787-4133-9bce-96687c7083ca tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:16.414290 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-18160b2c-e787-4133-9bce-96687c7083ca tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:16.420087 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-18160b2c-e787-4133-9bce-96687c7083ca tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:16.420538 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-18160b2c-e787-4133-9bce-96687c7083ca tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:16.421298 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-18160b2c-e787-4133-9bce-96687c7083ca tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:16.421727 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-18160b2c-e787-4133-9bce-96687c7083ca tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:16.431712 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b1c93325-bfa6-443d-930c-63d4ba49b4cf tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:16.439352 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b1c93325-bfa6-443d-930c-63d4ba49b4cf tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1462 microversion: 2.1 time: 0.095042 May 13 17:30:16.440170 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 303/585] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:16 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1462 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:16.444344 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a5afceaa-d492-46f9-a791-b06cf5f64014 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:16.444952 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a5afceaa-d492-46f9-a791-b06cf5f64014 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:16.454167 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a5afceaa-d492-46f9-a791-b06cf5f64014 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:16.454367 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-18160b2c-e787-4133-9bce-96687c7083ca tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48/ips" status: 200 len: 145 microversion: 2.1 time: 0.044970 May 13 17:30:16.454845 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 283/586] 10.222.0.64 () {58 vars in 1247 bytes} [Fri May 13 17:30:16 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48/ips => generated 145 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:30:16.459458 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a5afceaa-d492-46f9-a791-b06cf5f64014 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:16.461095 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a5afceaa-d492-46f9-a791-b06cf5f64014 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:16.462022 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a5afceaa-d492-46f9-a791-b06cf5f64014 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:16.476522 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8f7cb132-1596-4e17-87b8-3b5ce8da3fd1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:30:16.477051 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8f7cb132-1596-4e17-87b8-3b5ce8da3fd1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:16.482865 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8f7cb132-1596-4e17-87b8-3b5ce8da3fd1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:16.483563 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8f7cb132-1596-4e17-87b8-3b5ce8da3fd1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:16.484341 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8f7cb132-1596-4e17-87b8-3b5ce8da3fd1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:16.484784 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8f7cb132-1596-4e17-87b8-3b5ce8da3fd1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:16.512611 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-8f7cb132-1596-4e17-87b8-3b5ce8da3fd1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lazy-loading 'flavor' on Instance uuid 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:30:16.680037 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a5afceaa-d492-46f9-a791-b06cf5f64014 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:16.688436 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a5afceaa-d492-46f9-a791-b06cf5f64014 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 200 len: 1319 microversion: 2.1 time: 0.247483 May 13 17:30:16.689105 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 304/587] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:16 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:16.839903 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a4074efd-6045-444a-8d3a-37834363f2b6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:16.840741 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a4074efd-6045-444a-8d3a-37834363f2b6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:16.848980 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a4074efd-6045-444a-8d3a-37834363f2b6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:16.850160 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a4074efd-6045-444a-8d3a-37834363f2b6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:16.851353 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a4074efd-6045-444a-8d3a-37834363f2b6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:16.851643 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a4074efd-6045-444a-8d3a-37834363f2b6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:17.082732 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a4074efd-6045-444a-8d3a-37834363f2b6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:17.090055 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a4074efd-6045-444a-8d3a-37834363f2b6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.255215 May 13 17:30:17.090716 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 305/588] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:16 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:17.095062 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-2343aa6f-9ad9-4be2-8f08-15ba1484de97 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:17.095685 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-2343aa6f-9ad9-4be2-8f08-15ba1484de97 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:17.105380 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2343aa6f-9ad9-4be2-8f08-15ba1484de97 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:17.107725 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2343aa6f-9ad9-4be2-8f08-15ba1484de97 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:17.107725 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2343aa6f-9ad9-4be2-8f08-15ba1484de97 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:17.107725 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2343aa6f-9ad9-4be2-8f08-15ba1484de97 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:17.133051 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8f7cb132-1596-4e17-87b8-3b5ce8da3fd1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "POST /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67/action" status: 202 len: 0 microversion: 2.20 time: 0.660696 May 13 17:30:17.136963 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 284/589] 10.222.0.64 () {62 vars in 1318 bytes} [Fri May 13 17:30:16 2022] POST /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67/action => generated 0 bytes in 662 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 13 17:30:17.142330 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-449b12d9-5ed3-4448-b7d5-b6d92bd00ece tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:17.143155 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-449b12d9-5ed3-4448-b7d5-b6d92bd00ece tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:17.149785 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-449b12d9-5ed3-4448-b7d5-b6d92bd00ece tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:17.151040 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-449b12d9-5ed3-4448-b7d5-b6d92bd00ece tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:17.151908 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-449b12d9-5ed3-4448-b7d5-b6d92bd00ece tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:17.152351 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-449b12d9-5ed3-4448-b7d5-b6d92bd00ece tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:17.283727 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-449b12d9-5ed3-4448-b7d5-b6d92bd00ece tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:17.291795 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-449b12d9-5ed3-4448-b7d5-b6d92bd00ece tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:17.293279 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-449b12d9-5ed3-4448-b7d5-b6d92bd00ece tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:17.294434 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-449b12d9-5ed3-4448-b7d5-b6d92bd00ece tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.156097 May 13 17:30:17.295467 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 285/590] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:17 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:30:17.303360 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-40ea350a-d399-42a6-9971-377d5ee5b742 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:17.304691 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-40ea350a-d399-42a6-9971-377d5ee5b742 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:17.310944 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-40ea350a-d399-42a6-9971-377d5ee5b742 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:17.311406 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-40ea350a-d399-42a6-9971-377d5ee5b742 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:17.312170 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-40ea350a-d399-42a6-9971-377d5ee5b742 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:17.312605 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-40ea350a-d399-42a6-9971-377d5ee5b742 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:17.327247 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-2343aa6f-9ad9-4be2-8f08-15ba1484de97 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:17.335789 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-2343aa6f-9ad9-4be2-8f08-15ba1484de97 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.244042 May 13 17:30:17.337108 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 306/591] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:17 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:17.451527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-40ea350a-d399-42a6-9971-377d5ee5b742 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:17.459454 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-cb613370-8bdd-4ec6-a619-a95a94bccc65 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:17.459454 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-cb613370-8bdd-4ec6-a619-a95a94bccc65 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:17.460064 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-40ea350a-d399-42a6-9971-377d5ee5b742 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.162061 May 13 17:30:17.460336 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 286/592] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:17 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:17.467750 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cb613370-8bdd-4ec6-a619-a95a94bccc65 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:17.468967 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cb613370-8bdd-4ec6-a619-a95a94bccc65 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:17.469760 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cb613370-8bdd-4ec6-a619-a95a94bccc65 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:17.470199 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cb613370-8bdd-4ec6-a619-a95a94bccc65 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:17.562573 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-cb613370-8bdd-4ec6-a619-a95a94bccc65 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:17.569901 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-cb613370-8bdd-4ec6-a619-a95a94bccc65 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1462 microversion: 2.1 time: 0.117522 May 13 17:30:17.574107 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 307/593] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:17 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1462 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:17.705497 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1139bdc0-9f5c-4ca2-9e4e-68f0edad897b tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:17.706736 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1139bdc0-9f5c-4ca2-9e4e-68f0edad897b tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:17.713716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1139bdc0-9f5c-4ca2-9e4e-68f0edad897b tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:17.714169 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1139bdc0-9f5c-4ca2-9e4e-68f0edad897b tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:17.714981 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1139bdc0-9f5c-4ca2-9e4e-68f0edad897b tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:17.715390 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1139bdc0-9f5c-4ca2-9e4e-68f0edad897b tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:17.841756 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1139bdc0-9f5c-4ca2-9e4e-68f0edad897b tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:17.849964 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1139bdc0-9f5c-4ca2-9e4e-68f0edad897b tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 200 len: 1319 microversion: 2.1 time: 0.148242 May 13 17:30:17.850913 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 287/594] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:17 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:18.106864 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-78fd9f07-7751-4208-8f0b-4ea1692b68b5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:18.107762 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-78fd9f07-7751-4208-8f0b-4ea1692b68b5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:18.114300 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-78fd9f07-7751-4208-8f0b-4ea1692b68b5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:18.114835 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-78fd9f07-7751-4208-8f0b-4ea1692b68b5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:18.115748 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-78fd9f07-7751-4208-8f0b-4ea1692b68b5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:18.116231 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-78fd9f07-7751-4208-8f0b-4ea1692b68b5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:18.312948 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-20798231-5872-4166-8144-93540f13ec5d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:18.313553 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-20798231-5872-4166-8144-93540f13ec5d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:18.320419 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-20798231-5872-4166-8144-93540f13ec5d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:18.320866 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-20798231-5872-4166-8144-93540f13ec5d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:18.321924 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-20798231-5872-4166-8144-93540f13ec5d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:18.322534 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-20798231-5872-4166-8144-93540f13ec5d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:18.369464 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-78fd9f07-7751-4208-8f0b-4ea1692b68b5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:18.377203 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-78fd9f07-7751-4208-8f0b-4ea1692b68b5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.274078 May 13 17:30:18.379097 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 308/595] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:18 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:18.383819 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3bba1feb-54ec-4c41-b57b-1ead0f5f674c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:18.389270 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3bba1feb-54ec-4c41-b57b-1ead0f5f674c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:18.396600 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3bba1feb-54ec-4c41-b57b-1ead0f5f674c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:18.397047 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3bba1feb-54ec-4c41-b57b-1ead0f5f674c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:18.404612 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3bba1feb-54ec-4c41-b57b-1ead0f5f674c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:18.406031 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3bba1feb-54ec-4c41-b57b-1ead0f5f674c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:18.613957 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3bba1feb-54ec-4c41-b57b-1ead0f5f674c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:18.622203 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3bba1feb-54ec-4c41-b57b-1ead0f5f674c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.241976 May 13 17:30:18.622379 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-20798231-5872-4166-8144-93540f13ec5d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:18.623510 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 309/596] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:18 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:18.629122 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-427016ec-79f5-4b41-ae8a-360a8d235161 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:18.629920 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-427016ec-79f5-4b41-ae8a-360a8d235161 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:18.631971 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-20798231-5872-4166-8144-93540f13ec5d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:18.634290 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-20798231-5872-4166-8144-93540f13ec5d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:18.635770 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-20798231-5872-4166-8144-93540f13ec5d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.326492 May 13 17:30:18.637239 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 288/597] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:18 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:30:18.637501 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-427016ec-79f5-4b41-ae8a-360a8d235161 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:18.637971 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-427016ec-79f5-4b41-ae8a-360a8d235161 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:18.638762 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-427016ec-79f5-4b41-ae8a-360a8d235161 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:18.639240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-427016ec-79f5-4b41-ae8a-360a8d235161 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:18.654921 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-86a338c2-4416-4255-af95-096c2e7d7ec0 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:18.655584 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-86a338c2-4416-4255-af95-096c2e7d7ec0 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:18.661658 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-86a338c2-4416-4255-af95-096c2e7d7ec0 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:18.665902 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-86a338c2-4416-4255-af95-096c2e7d7ec0 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:18.665902 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-86a338c2-4416-4255-af95-096c2e7d7ec0 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:18.665902 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-86a338c2-4416-4255-af95-096c2e7d7ec0 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:18.706393 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-86a338c2-4416-4255-af95-096c2e7d7ec0 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:18.707504 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-86a338c2-4416-4255-af95-096c2e7d7ec0 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:18.707954 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-86a338c2-4416-4255-af95-096c2e7d7ec0 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lazy-loading 'fault' on Instance uuid 686847ed-a4cd-42fe-ae51-44ce52cf1ae4 {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:30:18.749782 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-86a338c2-4416-4255-af95-096c2e7d7ec0 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:18.757587 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-86a338c2-4416-4255-af95-096c2e7d7ec0 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1304 microversion: 2.1 time: 0.109665 May 13 17:30:18.758368 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 289/598] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:18 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1304 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:18.822841 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-427016ec-79f5-4b41-ae8a-360a8d235161 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:18.830337 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-427016ec-79f5-4b41-ae8a-360a8d235161 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.205626 May 13 17:30:18.832207 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 310/599] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:18 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:18.868460 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-061b7fe9-bb02-4a95-9708-49c22aa25d49 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:18.869167 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-061b7fe9-bb02-4a95-9708-49c22aa25d49 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:18.875546 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-061b7fe9-bb02-4a95-9708-49c22aa25d49 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:18.876077 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-061b7fe9-bb02-4a95-9708-49c22aa25d49 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:18.876919 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-061b7fe9-bb02-4a95-9708-49c22aa25d49 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:18.877448 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-061b7fe9-bb02-4a95-9708-49c22aa25d49 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:18.932983 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-1ca90d25-a908-4eec-b766-00f0903cae89 req-62540d41-9de7-4e54-bfd1-b0c0fc7aad4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d07e598b-0481-4f7e-9957-49cd7dbbac98", "tag": "53b14020-f762-46c1-859f-588cb62cbd07"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:30:18.950053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-1ca90d25-a908-4eec-b766-00f0903cae89 req-62540d41-9de7-4e54-bfd1-b0c0fc7aad4c service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:18.950932 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-1ca90d25-a908-4eec-b766-00f0903cae89 req-62540d41-9de7-4e54-bfd1-b0c0fc7aad4c service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:18.967738 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-1ca90d25-a908-4eec-b766-00f0903cae89 req-62540d41-9de7-4e54-bfd1-b0c0fc7aad4c service nova] Creating event network-changed:53b14020-f762-46c1-859f-588cb62cbd07 for instance d07e598b-0481-4f7e-9957-49cd7dbbac98 on hv-cinder-84178 May 13 17:30:18.975062 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-1ca90d25-a908-4eec-b766-00f0903cae89 req-62540d41-9de7-4e54-bfd1-b0c0fc7aad4c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046039 May 13 17:30:18.976095 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 311/600] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:30:19.125775 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-061b7fe9-bb02-4a95-9708-49c22aa25d49 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:19.135481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-061b7fe9-bb02-4a95-9708-49c22aa25d49 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 200 len: 1319 microversion: 2.1 time: 0.270807 May 13 17:30:19.136512 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 290/601] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:18 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 1319 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:19.396184 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-e997429c-7b7f-44a5-99c8-491942628226 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:19.396791 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-e997429c-7b7f-44a5-99c8-491942628226 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:19.404861 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e997429c-7b7f-44a5-99c8-491942628226 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:19.406838 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e997429c-7b7f-44a5-99c8-491942628226 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:19.406838 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e997429c-7b7f-44a5-99c8-491942628226 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:19.406838 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e997429c-7b7f-44a5-99c8-491942628226 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:19.596677 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-e997429c-7b7f-44a5-99c8-491942628226 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:19.605453 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-e997429c-7b7f-44a5-99c8-491942628226 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.214084 May 13 17:30:19.607719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 312/602] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:19 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:19.643555 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-58499277-99a0-4305-b5d9-013d5228d913 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:19.645019 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-58499277-99a0-4305-b5d9-013d5228d913 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:19.653829 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-58499277-99a0-4305-b5d9-013d5228d913 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:19.654337 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-58499277-99a0-4305-b5d9-013d5228d913 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:19.656130 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-58499277-99a0-4305-b5d9-013d5228d913 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:19.656512 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-c0a1fdda-e536-4a0d-8050-512ba5d29ca2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:19.657160 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-c0a1fdda-e536-4a0d-8050-512ba5d29ca2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:19.658953 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-58499277-99a0-4305-b5d9-013d5228d913 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:19.665809 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c0a1fdda-e536-4a0d-8050-512ba5d29ca2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:19.666260 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c0a1fdda-e536-4a0d-8050-512ba5d29ca2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:19.667034 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c0a1fdda-e536-4a0d-8050-512ba5d29ca2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:19.667488 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c0a1fdda-e536-4a0d-8050-512ba5d29ca2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:19.823869 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-58499277-99a0-4305-b5d9-013d5228d913 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:19.831224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-58499277-99a0-4305-b5d9-013d5228d913 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.193513 May 13 17:30:19.832400 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 291/603] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:19 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:19.836975 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e8e73672-64f6-4ba1-ac3f-64423060da73 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:19.837532 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e8e73672-64f6-4ba1-ac3f-64423060da73 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:19.843595 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e8e73672-64f6-4ba1-ac3f-64423060da73 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:19.844250 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e8e73672-64f6-4ba1-ac3f-64423060da73 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:19.845422 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e8e73672-64f6-4ba1-ac3f-64423060da73 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:19.846146 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e8e73672-64f6-4ba1-ac3f-64423060da73 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:19.851436 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c0a1fdda-e536-4a0d-8050-512ba5d29ca2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:19.861249 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c0a1fdda-e536-4a0d-8050-512ba5d29ca2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:19.862973 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c0a1fdda-e536-4a0d-8050-512ba5d29ca2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:19.864842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-c0a1fdda-e536-4a0d-8050-512ba5d29ca2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.214514 May 13 17:30:19.868967 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 313/604] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:19 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:30:19.874078 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-5d03acfb-b4f5-49e8-abd4-e872d2f715e7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:19.874927 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-5d03acfb-b4f5-49e8-abd4-e872d2f715e7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:19.883662 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e8e73672-64f6-4ba1-ac3f-64423060da73 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:19.884716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e8e73672-64f6-4ba1-ac3f-64423060da73 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:19.885239 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-e8e73672-64f6-4ba1-ac3f-64423060da73 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lazy-loading 'fault' on Instance uuid 686847ed-a4cd-42fe-ae51-44ce52cf1ae4 {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:30:19.889084 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5d03acfb-b4f5-49e8-abd4-e872d2f715e7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:19.889745 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5d03acfb-b4f5-49e8-abd4-e872d2f715e7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:19.891436 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5d03acfb-b4f5-49e8-abd4-e872d2f715e7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:19.892049 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5d03acfb-b4f5-49e8-abd4-e872d2f715e7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:19.928987 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e8e73672-64f6-4ba1-ac3f-64423060da73 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:19.937458 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e8e73672-64f6-4ba1-ac3f-64423060da73 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1304 microversion: 2.1 time: 0.103791 May 13 17:30:19.938050 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 292/605] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:19 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1304 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:20.048187 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-5d03acfb-b4f5-49e8-abd4-e872d2f715e7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:20.055714 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-5d03acfb-b4f5-49e8-abd4-e872d2f715e7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.185448 May 13 17:30:20.056283 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 314/606] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:19 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:20.161260 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-36477de9-9164-4c1f-8769-4ae13f6609d9 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:20.161874 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-36477de9-9164-4c1f-8769-4ae13f6609d9 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:20.168186 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-36477de9-9164-4c1f-8769-4ae13f6609d9 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:20.168574 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-36477de9-9164-4c1f-8769-4ae13f6609d9 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:20.169342 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-36477de9-9164-4c1f-8769-4ae13f6609d9 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:20.169786 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-36477de9-9164-4c1f-8769-4ae13f6609d9 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:20.261919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-e77998f3-d8f9-49e9-b1b3-7cf4068aa554 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee464b49-d7b0-43fe-ab32-b091fadd0591"}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:30:20.263027 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-e77998f3-d8f9-49e9-b1b3-7cf4068aa554 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:20.273969 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e77998f3-d8f9-49e9-b1b3-7cf4068aa554 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:20.273969 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e77998f3-d8f9-49e9-b1b3-7cf4068aa554 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:20.274407 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e77998f3-d8f9-49e9-b1b3-7cf4068aa554 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:20.274842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e77998f3-d8f9-49e9-b1b3-7cf4068aa554 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:20.329194 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-36477de9-9164-4c1f-8769-4ae13f6609d9 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:20.336623 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-36477de9-9164-4c1f-8769-4ae13f6609d9 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 200 len: 1508 microversion: 2.1 time: 0.180767 May 13 17:30:20.337256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 293/607] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:20 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 1508 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:20.623442 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ed970f3e-0cba-4e9d-902f-4b9e912e84ec tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:20.624056 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ed970f3e-0cba-4e9d-902f-4b9e912e84ec tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:20.629968 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ed970f3e-0cba-4e9d-902f-4b9e912e84ec tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:20.632812 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ed970f3e-0cba-4e9d-902f-4b9e912e84ec tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:20.632812 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ed970f3e-0cba-4e9d-902f-4b9e912e84ec tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:20.632812 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ed970f3e-0cba-4e9d-902f-4b9e912e84ec tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:20.798995 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ed970f3e-0cba-4e9d-902f-4b9e912e84ec tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:20.808154 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ed970f3e-0cba-4e9d-902f-4b9e912e84ec tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.190020 May 13 17:30:20.817727 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 294/608] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:20 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:20.849505 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-96752973-8cdc-4460-9106-7e65b1c0f6cb tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:20.850109 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-96752973-8cdc-4460-9106-7e65b1c0f6cb tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:20.855971 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-96752973-8cdc-4460-9106-7e65b1c0f6cb tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:20.856472 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-96752973-8cdc-4460-9106-7e65b1c0f6cb tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:20.857262 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-96752973-8cdc-4460-9106-7e65b1c0f6cb tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:20.857695 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-96752973-8cdc-4460-9106-7e65b1c0f6cb tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:20.987116 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-96752973-8cdc-4460-9106-7e65b1c0f6cb tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:21.007810 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-96752973-8cdc-4460-9106-7e65b1c0f6cb tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.153659 May 13 17:30:21.007810 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 295/609] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:20 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:21.007810 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7e27b3b3-5478-4508-bdbe-1f75a00026d2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:21.007810 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7e27b3b3-5478-4508-bdbe-1f75a00026d2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:21.010543 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7e27b3b3-5478-4508-bdbe-1f75a00026d2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:21.010992 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7e27b3b3-5478-4508-bdbe-1f75a00026d2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:21.011780 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7e27b3b3-5478-4508-bdbe-1f75a00026d2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:21.012216 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7e27b3b3-5478-4508-bdbe-1f75a00026d2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:21.149027 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7e27b3b3-5478-4508-bdbe-1f75a00026d2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:21.157177 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7e27b3b3-5478-4508-bdbe-1f75a00026d2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:21.158672 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7e27b3b3-5478-4508-bdbe-1f75a00026d2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:21.160422 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7e27b3b3-5478-4508-bdbe-1f75a00026d2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.159542 May 13 17:30:21.160982 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 296/610] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:20 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:30:21.165293 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-412a3aca-2bee-4325-81e0-be2a8b3a545b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:21.165887 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-412a3aca-2bee-4325-81e0-be2a8b3a545b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:21.172077 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-412a3aca-2bee-4325-81e0-be2a8b3a545b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:21.172528 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-412a3aca-2bee-4325-81e0-be2a8b3a545b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:21.173311 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-412a3aca-2bee-4325-81e0-be2a8b3a545b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:21.173743 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-412a3aca-2bee-4325-81e0-be2a8b3a545b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:21.204504 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-412a3aca-2bee-4325-81e0-be2a8b3a545b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:21.205052 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-412a3aca-2bee-4325-81e0-be2a8b3a545b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:21.205507 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-412a3aca-2bee-4325-81e0-be2a8b3a545b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lazy-loading 'fault' on Instance uuid 686847ed-a4cd-42fe-ae51-44ce52cf1ae4 {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:30:21.247465 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-412a3aca-2bee-4325-81e0-be2a8b3a545b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:21.255973 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-412a3aca-2bee-4325-81e0-be2a8b3a545b tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1304 microversion: 2.1 time: 0.094012 May 13 17:30:21.256561 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 297/611] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:21 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1304 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:21.261765 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f449cbaa-0da4-4826-97d1-5102d72ef46d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:21.262363 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f449cbaa-0da4-4826-97d1-5102d72ef46d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:21.271024 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f449cbaa-0da4-4826-97d1-5102d72ef46d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:21.271516 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f449cbaa-0da4-4826-97d1-5102d72ef46d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:21.272295 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f449cbaa-0da4-4826-97d1-5102d72ef46d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:21.272745 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f449cbaa-0da4-4826-97d1-5102d72ef46d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:21.404390 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f449cbaa-0da4-4826-97d1-5102d72ef46d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:21.412062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f449cbaa-0da4-4826-97d1-5102d72ef46d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.154551 May 13 17:30:21.412625 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 298/612] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:21 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:21.824185 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2add43b8-dd28-4839-82db-7486d1b9c4f2 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:21.824824 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2add43b8-dd28-4839-82db-7486d1b9c4f2 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:21.830666 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2add43b8-dd28-4839-82db-7486d1b9c4f2 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:21.831112 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2add43b8-dd28-4839-82db-7486d1b9c4f2 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:21.831897 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2add43b8-dd28-4839-82db-7486d1b9c4f2 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:21.832403 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2add43b8-dd28-4839-82db-7486d1b9c4f2 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:21.976706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2add43b8-dd28-4839-82db-7486d1b9c4f2 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:21.984072 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2add43b8-dd28-4839-82db-7486d1b9c4f2 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.163615 May 13 17:30:21.984638 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 299/613] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:21 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:21.989717 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5ace0cd8-1845-4b77-bc91-03534a40e232 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-452571533"}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:30:21.990304 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5ace0cd8-1845-4b77-bc91-03534a40e232 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:21.996017 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5ace0cd8-1845-4b77-bc91-03534a40e232 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:21.996466 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5ace0cd8-1845-4b77-bc91-03534a40e232 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:21.997236 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5ace0cd8-1845-4b77-bc91-03534a40e232 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:21.997672 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5ace0cd8-1845-4b77-bc91-03534a40e232 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:22.129503 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.network.security_group_api [None req-5ace0cd8-1845-4b77-bc91-03534a40e232 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Adding security group 25628f21-2480-4d12-a2e2-3c0504bba483 to port 53b14020-f762-46c1-859f-588cb62cbd07 May 13 17:30:22.557493 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5ace0cd8-1845-4b77-bc91-03534a40e232 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "POST /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98/action" status: 202 len: 0 microversion: 2.1 time: 0.571787 May 13 17:30:22.558539 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 300/614] 10.222.0.64 () {60 vars in 1277 bytes} [Fri May 13 17:30:21 2022] POST /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98/action => generated 0 bytes in 573 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:30:22.564505 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-853b7e91-a414-4ef2-add6-7d7e73b9c68a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:22.565604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-853b7e91-a414-4ef2-add6-7d7e73b9c68a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:22.571781 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-853b7e91-a414-4ef2-add6-7d7e73b9c68a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:22.572314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-853b7e91-a414-4ef2-add6-7d7e73b9c68a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:22.573169 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-853b7e91-a414-4ef2-add6-7d7e73b9c68a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:22.573724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-853b7e91-a414-4ef2-add6-7d7e73b9c68a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:22.732843 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-853b7e91-a414-4ef2-add6-7d7e73b9c68a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:22.741008 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-853b7e91-a414-4ef2-add6-7d7e73b9c68a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.181568 May 13 17:30:22.750132 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 301/615] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:22 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:22.750132 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6fff956d-a9bf-46ce-9b8c-0b6f3210d43d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:22.750132 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6fff956d-a9bf-46ce-9b8c-0b6f3210d43d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:22.754503 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6fff956d-a9bf-46ce-9b8c-0b6f3210d43d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:22.755094 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6fff956d-a9bf-46ce-9b8c-0b6f3210d43d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:22.756219 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6fff956d-a9bf-46ce-9b8c-0b6f3210d43d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:22.756937 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6fff956d-a9bf-46ce-9b8c-0b6f3210d43d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:22.896485 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6fff956d-a9bf-46ce-9b8c-0b6f3210d43d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:22.904969 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6fff956d-a9bf-46ce-9b8c-0b6f3210d43d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:22.906466 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6fff956d-a9bf-46ce-9b8c-0b6f3210d43d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:22.907729 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6fff956d-a9bf-46ce-9b8c-0b6f3210d43d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.164603 May 13 17:30:22.908288 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 302/616] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:22 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:30:22.913210 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f5d00cea-dcc9-4658-b818-75ae1cf1fc0f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:22.913814 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f5d00cea-dcc9-4658-b818-75ae1cf1fc0f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:22.920727 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f5d00cea-dcc9-4658-b818-75ae1cf1fc0f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:22.921182 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f5d00cea-dcc9-4658-b818-75ae1cf1fc0f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:22.921974 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f5d00cea-dcc9-4658-b818-75ae1cf1fc0f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:22.922410 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f5d00cea-dcc9-4658-b818-75ae1cf1fc0f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:22.955624 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f5d00cea-dcc9-4658-b818-75ae1cf1fc0f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:22.956013 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f5d00cea-dcc9-4658-b818-75ae1cf1fc0f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:22.957020 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-f5d00cea-dcc9-4658-b818-75ae1cf1fc0f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lazy-loading 'fault' on Instance uuid 686847ed-a4cd-42fe-ae51-44ce52cf1ae4 {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:30:23.004477 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f5d00cea-dcc9-4658-b818-75ae1cf1fc0f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:23.012208 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f5d00cea-dcc9-4658-b818-75ae1cf1fc0f tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1304 microversion: 2.1 time: 0.102711 May 13 17:30:23.012789 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 303/617] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:22 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:23.017335 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-93f9a6fa-2c72-4343-a904-41e44d7c6dbb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:23.017942 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-93f9a6fa-2c72-4343-a904-41e44d7c6dbb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:23.024949 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-93f9a6fa-2c72-4343-a904-41e44d7c6dbb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:23.025717 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-93f9a6fa-2c72-4343-a904-41e44d7c6dbb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:23.026532 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-93f9a6fa-2c72-4343-a904-41e44d7c6dbb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:23.027035 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-93f9a6fa-2c72-4343-a904-41e44d7c6dbb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:23.170376 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-93f9a6fa-2c72-4343-a904-41e44d7c6dbb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:23.179723 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-93f9a6fa-2c72-4343-a904-41e44d7c6dbb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.165887 May 13 17:30:23.180411 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 304/618] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:23 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:23.186067 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-bfa57574-2c35-4e92-abb3-2a5bdca12d22 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:23.186445 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-bfa57574-2c35-4e92-abb3-2a5bdca12d22 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:23.195587 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bfa57574-2c35-4e92-abb3-2a5bdca12d22 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:23.196041 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bfa57574-2c35-4e92-abb3-2a5bdca12d22 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:23.196831 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bfa57574-2c35-4e92-abb3-2a5bdca12d22 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:23.197278 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bfa57574-2c35-4e92-abb3-2a5bdca12d22 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:23.343790 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-bfa57574-2c35-4e92-abb3-2a5bdca12d22 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:23.353704 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-bfa57574-2c35-4e92-abb3-2a5bdca12d22 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1641 microversion: 2.1 time: 0.172190 May 13 17:30:23.354294 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 305/619] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:23 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1641 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:23.359013 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-1c65c03b-1f2d-408f-9c12-bbfe7fc04ff0 req-a72c907a-2827-4d98-aec1-d3e6bc252e41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d07e598b-0481-4f7e-9957-49cd7dbbac98", "tag": "53b14020-f762-46c1-859f-588cb62cbd07"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:30:23.366962 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-1c65c03b-1f2d-408f-9c12-bbfe7fc04ff0 req-a72c907a-2827-4d98-aec1-d3e6bc252e41 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:23.367604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-1c65c03b-1f2d-408f-9c12-bbfe7fc04ff0 req-a72c907a-2827-4d98-aec1-d3e6bc252e41 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:23.378773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-1c65c03b-1f2d-408f-9c12-bbfe7fc04ff0 req-a72c907a-2827-4d98-aec1-d3e6bc252e41 service nova] Creating event network-changed:53b14020-f762-46c1-859f-588cb62cbd07 for instance d07e598b-0481-4f7e-9957-49cd7dbbac98 on hv-cinder-84178 May 13 17:30:23.384207 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-1c65c03b-1f2d-408f-9c12-bbfe7fc04ff0 req-a72c907a-2827-4d98-aec1-d3e6bc252e41 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028803 May 13 17:30:23.384972 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 306/620] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:30:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:30:23.389869 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-aa9081cc-fffb-4e78-b69f-0b2df4cbffd3 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:23.390565 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-aa9081cc-fffb-4e78-b69f-0b2df4cbffd3 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:23.397390 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aa9081cc-fffb-4e78-b69f-0b2df4cbffd3 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:23.397843 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aa9081cc-fffb-4e78-b69f-0b2df4cbffd3 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:23.398799 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aa9081cc-fffb-4e78-b69f-0b2df4cbffd3 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:23.399738 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aa9081cc-fffb-4e78-b69f-0b2df4cbffd3 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:23.537582 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-aa9081cc-fffb-4e78-b69f-0b2df4cbffd3 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:23.545315 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-aa9081cc-fffb-4e78-b69f-0b2df4cbffd3 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.159429 May 13 17:30:23.545996 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 307/621] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:23 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:23.757890 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-418401c8-b2e8-4258-b386-807f2c7211aa tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:23.758625 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-418401c8-b2e8-4258-b386-807f2c7211aa tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:23.764956 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-418401c8-b2e8-4258-b386-807f2c7211aa tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:23.765497 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-418401c8-b2e8-4258-b386-807f2c7211aa tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:23.766337 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-418401c8-b2e8-4258-b386-807f2c7211aa tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:23.767042 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-418401c8-b2e8-4258-b386-807f2c7211aa tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:23.909928 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-418401c8-b2e8-4258-b386-807f2c7211aa tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:23.917177 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-418401c8-b2e8-4258-b386-807f2c7211aa tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.163609 May 13 17:30:23.917745 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 308/622] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:23 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:23.928261 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7cf39fae-0df6-45f0-b12a-c177534a3921 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:23.928874 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7cf39fae-0df6-45f0-b12a-c177534a3921 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:23.935325 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7cf39fae-0df6-45f0-b12a-c177534a3921 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:23.936210 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7cf39fae-0df6-45f0-b12a-c177534a3921 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:23.938405 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7cf39fae-0df6-45f0-b12a-c177534a3921 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:23.938405 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7cf39fae-0df6-45f0-b12a-c177534a3921 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:24.074818 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7cf39fae-0df6-45f0-b12a-c177534a3921 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:24.083301 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7cf39fae-0df6-45f0-b12a-c177534a3921 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:24.084772 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7cf39fae-0df6-45f0-b12a-c177534a3921 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:24.085953 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7cf39fae-0df6-45f0-b12a-c177534a3921 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.162366 May 13 17:30:24.086503 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 309/623] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:23 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:30:24.090873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ed81f9d4-e62a-44f1-9f9d-2fcfaa1b7c30 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:24.091492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ed81f9d4-e62a-44f1-9f9d-2fcfaa1b7c30 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:24.097324 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ed81f9d4-e62a-44f1-9f9d-2fcfaa1b7c30 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:24.097775 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ed81f9d4-e62a-44f1-9f9d-2fcfaa1b7c30 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:24.098529 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ed81f9d4-e62a-44f1-9f9d-2fcfaa1b7c30 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:24.098966 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ed81f9d4-e62a-44f1-9f9d-2fcfaa1b7c30 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:24.129694 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ed81f9d4-e62a-44f1-9f9d-2fcfaa1b7c30 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:24.130142 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ed81f9d4-e62a-44f1-9f9d-2fcfaa1b7c30 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:24.130597 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-ed81f9d4-e62a-44f1-9f9d-2fcfaa1b7c30 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lazy-loading 'fault' on Instance uuid 686847ed-a4cd-42fe-ae51-44ce52cf1ae4 {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:30:24.174403 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ed81f9d4-e62a-44f1-9f9d-2fcfaa1b7c30 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e7d764501bed41d99941c6e083e19482', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6fceef0782240ccb486341a9007e4b0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:24.182379 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ed81f9d4-e62a-44f1-9f9d-2fcfaa1b7c30 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 200 len: 1304 microversion: 2.1 time: 0.094944 May 13 17:30:24.182931 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 310/624] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:24 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:24.196633 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-566a0c77-0a4d-4969-bdf6-0c5771d99f49 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:24.197232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-566a0c77-0a4d-4969-bdf6-0c5771d99f49 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:24.202696 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-566a0c77-0a4d-4969-bdf6-0c5771d99f49 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:24.203164 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-566a0c77-0a4d-4969-bdf6-0c5771d99f49 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:24.203921 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-566a0c77-0a4d-4969-bdf6-0c5771d99f49 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:24.204354 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-566a0c77-0a4d-4969-bdf6-0c5771d99f49 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:24.342262 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-566a0c77-0a4d-4969-bdf6-0c5771d99f49 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:24.350198 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-566a0c77-0a4d-4969-bdf6-0c5771d99f49 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.157003 May 13 17:30:24.350752 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 311/625] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:24 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:24.562558 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-32c71335-1481-4fdc-82fa-83fe038d462a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:24.563116 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-32c71335-1481-4fdc-82fa-83fe038d462a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:24.569070 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-32c71335-1481-4fdc-82fa-83fe038d462a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:24.569520 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-32c71335-1481-4fdc-82fa-83fe038d462a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:24.570282 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-32c71335-1481-4fdc-82fa-83fe038d462a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:24.570783 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-32c71335-1481-4fdc-82fa-83fe038d462a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:24.803262 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-32c71335-1481-4fdc-82fa-83fe038d462a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:24.810507 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-32c71335-1481-4fdc-82fa-83fe038d462a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.252092 May 13 17:30:24.811074 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 312/626] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:24 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:24.939342 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9a91ff6e-9269-49a5-9995-a010213ae333 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:24.939998 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9a91ff6e-9269-49a5-9995-a010213ae333 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:24.946923 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a91ff6e-9269-49a5-9995-a010213ae333 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:24.947416 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a91ff6e-9269-49a5-9995-a010213ae333 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:24.948179 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a91ff6e-9269-49a5-9995-a010213ae333 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:24.948615 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a91ff6e-9269-49a5-9995-a010213ae333 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:25.078146 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9a91ff6e-9269-49a5-9995-a010213ae333 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:25.085890 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9a91ff6e-9269-49a5-9995-a010213ae333 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.150555 May 13 17:30:25.086457 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 313/627] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:24 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:25.103714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5c7927a2-19bc-4e45-9ce8-d91175439a14 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:25.104314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5c7927a2-19bc-4e45-9ce8-d91175439a14 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:25.109948 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5c7927a2-19bc-4e45-9ce8-d91175439a14 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:25.110403 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5c7927a2-19bc-4e45-9ce8-d91175439a14 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:25.111288 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5c7927a2-19bc-4e45-9ce8-d91175439a14 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:25.111740 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5c7927a2-19bc-4e45-9ce8-d91175439a14 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:25.244936 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5c7927a2-19bc-4e45-9ce8-d91175439a14 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:25.252851 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5c7927a2-19bc-4e45-9ce8-d91175439a14 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:25.254902 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5c7927a2-19bc-4e45-9ce8-d91175439a14 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:25.256079 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5c7927a2-19bc-4e45-9ce8-d91175439a14 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.155884 May 13 17:30:25.256638 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 314/628] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:25 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:30:25.260890 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-cc2f052c-3960-4c5d-9f59-0dfb8e589779 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:25.261492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-cc2f052c-3960-4c5d-9f59-0dfb8e589779 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] [instance: 686847ed-a4cd-42fe-ae51-44ce52cf1ae4] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:25.266884 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cc2f052c-3960-4c5d-9f59-0dfb8e589779 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:25.267386 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cc2f052c-3960-4c5d-9f59-0dfb8e589779 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:25.268136 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cc2f052c-3960-4c5d-9f59-0dfb8e589779 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:25.268572 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cc2f052c-3960-4c5d-9f59-0dfb8e589779 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:25.282161 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-cc2f052c-3960-4c5d-9f59-0dfb8e589779 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] HTTP exception thrown: Instance 686847ed-a4cd-42fe-ae51-44ce52cf1ae4 could not be found. May 13 17:30:25.283922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-cc2f052c-3960-4c5d-9f59-0dfb8e589779 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Request method failure captured: May 13 17:30:25.283922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 HTTP/1.1 May 13 17:30:25.283922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:30:25.283922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:30:25.283922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:30:25.283922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:30:25.283922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:30:25.283922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:30:25.283922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:30:25.283922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:30:25.283922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpVBrsbKPZ8RQNxMH74iUtK-jL9mi-NBuUi3AqZrnArpUgy2OeVvMGQoP5eSDkjKfD3_ex7KlOoFe8sS-wKNEduHvvhajzCqFS8opel6XHF52qwV9QSY_OGsPnV51GoYkZgjmmDhOMhU0ShLX9Nrtl2icpv-0gSIaEUD-WWCgU75KgQ May 13 17:30:25.283922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:30:25.283922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:30:25.283922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:30:25.283922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:30:25.283922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:30:25.283922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:30:25.283922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: f6fceef0782240ccb486341a9007e4b0 May 13 17:30:25.283922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-VolumesActionsTest-1369299399 May 13 17:30:25.283922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:30:25.283922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:30:25.285424 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f6fceef0782240ccb486341a9007e4b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f6fceef0782240ccb486341a9007e4b0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f6fceef0782240ccb486341a9007e4b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f6fceef0782240ccb486341a9007e4b0"}]}] May 13 17:30:25.285424 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-VolumesActionsTest-1369299399 May 13 17:30:25.285424 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: f6fceef0782240ccb486341a9007e4b0 May 13 17:30:25.285424 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-VolumesActionsTest-1369299399 May 13 17:30:25.285424 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-VolumesActionsTest-1369299399-project May 13 17:30:25.285424 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:30:25.285424 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:30:25.285424 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: e7d764501bed41d99941c6e083e19482 May 13 17:30:25.285424 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-VolumesActionsTest-1369299399-project May 13 17:30:25.285424 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: > May 13 17:30:25.285424 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Instance 686847ed-a4cd-42fe-ae51-44ce52cf1ae4 could not be found. May 13 17:30:25.285424 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '686847ed-a4cd-42fe-ae51-44ce52cf1ae4'} May 13 17:30:25.286296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:30:25.286296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:30:25.286296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:30:25.286296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:30:25.286296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:30:25.286296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:30:25.286296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:30:25.286296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:30:25.286296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:30:25.286296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:30:25.286296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 686847ed-a4cd-42fe-ae51-44ce52cf1ae4 could not be found. May 13 17:30:25.286296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:30:25.286296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:30:25.286296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:30:25.286296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:30:25.286296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:30:25.286296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:30:25.286296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:30:25.286296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:30:25.286296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:30:25.287773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:30:25.287773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:30:25.287773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:30:25.287773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:30:25.287773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:30:25.287773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:30:25.287773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:30:25.287773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 686847ed-a4cd-42fe-ae51-44ce52cf1ae4 could not be found. May 13 17:30:25.287773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:30:25.287773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:30:25.287773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:30:25.287773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:30:25.287773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:30:25.287773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:30:25.287773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:30:25.287773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:30:25.287773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 686847ed-a4cd-42fe-ae51-44ce52cf1ae4 could not be found. May 13 17:30:25.287773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:30:25.288974 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-cc2f052c-3960-4c5d-9f59-0dfb8e589779 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] Returning 404 to user: Instance 686847ed-a4cd-42fe-ae51-44ce52cf1ae4 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:30:25.288974 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-cc2f052c-3960-4c5d-9f59-0dfb8e589779 tempest-VolumesActionsTest-1369299399 tempest-VolumesActionsTest-1369299399-project] 10.222.0.64 "GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4" status: 404 len: 111 microversion: 2.1 time: 0.027744 May 13 17:30:25.288974 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 315/629] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:25 2022] GET /compute/v2.1/servers/686847ed-a4cd-42fe-ae51-44ce52cf1ae4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:30:25.366608 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c6b591d3-d410-41bd-aef8-1ea06f3ac44e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:25.367264 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c6b591d3-d410-41bd-aef8-1ea06f3ac44e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:25.373238 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c6b591d3-d410-41bd-aef8-1ea06f3ac44e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:25.373768 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c6b591d3-d410-41bd-aef8-1ea06f3ac44e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:25.374544 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c6b591d3-d410-41bd-aef8-1ea06f3ac44e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:25.374984 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c6b591d3-d410-41bd-aef8-1ea06f3ac44e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:25.506251 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c6b591d3-d410-41bd-aef8-1ea06f3ac44e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:25.514529 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c6b591d3-d410-41bd-aef8-1ea06f3ac44e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.152024 May 13 17:30:25.515106 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 316/630] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:25 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:25.826236 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-95b46dca-b17b-447d-8e80-769af7cf9fd8 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:25.826846 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-95b46dca-b17b-447d-8e80-769af7cf9fd8 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:25.832902 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-95b46dca-b17b-447d-8e80-769af7cf9fd8 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:25.833355 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-95b46dca-b17b-447d-8e80-769af7cf9fd8 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:25.834124 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-95b46dca-b17b-447d-8e80-769af7cf9fd8 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:25.834589 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-95b46dca-b17b-447d-8e80-769af7cf9fd8 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:25.973904 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-95b46dca-b17b-447d-8e80-769af7cf9fd8 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:25.981721 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-95b46dca-b17b-447d-8e80-769af7cf9fd8 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.159356 May 13 17:30:25.982285 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 317/631] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:25 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:26.102577 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-736488cd-b3bb-4fcb-8912-b67557f06e4f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:26.103248 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-736488cd-b3bb-4fcb-8912-b67557f06e4f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:26.109349 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-736488cd-b3bb-4fcb-8912-b67557f06e4f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:26.109791 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-736488cd-b3bb-4fcb-8912-b67557f06e4f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:26.110588 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-736488cd-b3bb-4fcb-8912-b67557f06e4f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:26.111029 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-736488cd-b3bb-4fcb-8912-b67557f06e4f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:26.249509 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-736488cd-b3bb-4fcb-8912-b67557f06e4f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:26.257306 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-736488cd-b3bb-4fcb-8912-b67557f06e4f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.159048 May 13 17:30:26.257956 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 318/632] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:26 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:26.274700 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-792adbd6-fa79-4b3a-b3d4-5424150602fe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:26.275343 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-792adbd6-fa79-4b3a-b3d4-5424150602fe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:26.282065 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-792adbd6-fa79-4b3a-b3d4-5424150602fe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:26.282520 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-792adbd6-fa79-4b3a-b3d4-5424150602fe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:26.283356 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-792adbd6-fa79-4b3a-b3d4-5424150602fe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:26.283796 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-792adbd6-fa79-4b3a-b3d4-5424150602fe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:26.424570 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-792adbd6-fa79-4b3a-b3d4-5424150602fe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:26.433215 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-792adbd6-fa79-4b3a-b3d4-5424150602fe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:26.434715 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-792adbd6-fa79-4b3a-b3d4-5424150602fe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:26.435921 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-792adbd6-fa79-4b3a-b3d4-5424150602fe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.166210 May 13 17:30:26.436679 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 319/633] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:26 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:30:26.531866 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e978acbe-43e9-4449-aeac-1eac28b826a7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:26.532613 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e978acbe-43e9-4449-aeac-1eac28b826a7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:26.538860 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e978acbe-43e9-4449-aeac-1eac28b826a7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:26.539450 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e978acbe-43e9-4449-aeac-1eac28b826a7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:26.540223 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e978acbe-43e9-4449-aeac-1eac28b826a7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:26.540663 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e978acbe-43e9-4449-aeac-1eac28b826a7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:26.741669 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e978acbe-43e9-4449-aeac-1eac28b826a7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:26.748983 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e978acbe-43e9-4449-aeac-1eac28b826a7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.221582 May 13 17:30:26.749560 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 320/634] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:26 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:26.757255 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-9ad97a96-e5e7-4cc0-a663-bf4a587dd254 req-c173a0a1-223c-41fb-97c7-11f7aa7a08cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2", "name": "network-vif-plugged", "status": "completed", "tag": "59800603-642e-4f31-b41b-ffa2355488f5"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:30:26.765481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-9ad97a96-e5e7-4cc0-a663-bf4a587dd254 req-c173a0a1-223c-41fb-97c7-11f7aa7a08cb service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:26.766041 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-9ad97a96-e5e7-4cc0-a663-bf4a587dd254 req-c173a0a1-223c-41fb-97c7-11f7aa7a08cb service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:26.778346 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-9ad97a96-e5e7-4cc0-a663-bf4a587dd254 req-c173a0a1-223c-41fb-97c7-11f7aa7a08cb service nova] Creating event network-vif-plugged:59800603-642e-4f31-b41b-ffa2355488f5 for instance 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 on hv-cinder-84178 May 13 17:30:26.783548 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-9ad97a96-e5e7-4cc0-a663-bf4a587dd254 req-c173a0a1-223c-41fb-97c7-11f7aa7a08cb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031800 May 13 17:30:26.784272 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 321/635] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:30:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:30:27.000324 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8454e7a6-44dd-4d1c-881b-dd562862e74d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:27.001719 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8454e7a6-44dd-4d1c-881b-dd562862e74d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:27.008842 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8454e7a6-44dd-4d1c-881b-dd562862e74d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:27.009301 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8454e7a6-44dd-4d1c-881b-dd562862e74d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:27.010085 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8454e7a6-44dd-4d1c-881b-dd562862e74d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:27.010530 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8454e7a6-44dd-4d1c-881b-dd562862e74d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:27.147372 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8454e7a6-44dd-4d1c-881b-dd562862e74d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:27.154657 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8454e7a6-44dd-4d1c-881b-dd562862e74d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.159217 May 13 17:30:27.155377 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 322/636] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:26 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:27.206369 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-e77998f3-d8f9-49e9-b1b3-7cf4068aa554 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "POST /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.948330 May 13 17:30:27.207010 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 315/637] 10.222.0.64 () {60 vars in 1322 bytes} [Fri May 13 17:30:20 2022] POST /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48/os-volume_attachments => generated 194 bytes in 6950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:30:27.273763 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a3e8ccfb-f225-42a7-b00e-d5f4a3933a27 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:27.274359 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a3e8ccfb-f225-42a7-b00e-d5f4a3933a27 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:27.280213 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a3e8ccfb-f225-42a7-b00e-d5f4a3933a27 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:27.280661 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a3e8ccfb-f225-42a7-b00e-d5f4a3933a27 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:27.281479 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a3e8ccfb-f225-42a7-b00e-d5f4a3933a27 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:27.281905 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a3e8ccfb-f225-42a7-b00e-d5f4a3933a27 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:27.409140 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a3e8ccfb-f225-42a7-b00e-d5f4a3933a27 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:27.417163 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a3e8ccfb-f225-42a7-b00e-d5f4a3933a27 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.147228 May 13 17:30:27.417724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 323/638] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:27 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:27.456529 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d0cc1abf-0ffc-49b8-a42c-9423111c02b7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:27.457218 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d0cc1abf-0ffc-49b8-a42c-9423111c02b7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:27.464695 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d0cc1abf-0ffc-49b8-a42c-9423111c02b7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:27.465153 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d0cc1abf-0ffc-49b8-a42c-9423111c02b7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:27.465941 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d0cc1abf-0ffc-49b8-a42c-9423111c02b7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:27.466383 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d0cc1abf-0ffc-49b8-a42c-9423111c02b7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:27.600989 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d0cc1abf-0ffc-49b8-a42c-9423111c02b7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:27.610021 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d0cc1abf-0ffc-49b8-a42c-9423111c02b7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:27.611808 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d0cc1abf-0ffc-49b8-a42c-9423111c02b7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:27.612996 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d0cc1abf-0ffc-49b8-a42c-9423111c02b7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.160835 May 13 17:30:27.613625 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 316/639] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:27 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:30:27.772296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-29a96ca4-7d21-41e2-8cc6-2275f561d821 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:27.772940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-29a96ca4-7d21-41e2-8cc6-2275f561d821 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:27.779413 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-29a96ca4-7d21-41e2-8cc6-2275f561d821 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:27.784018 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-29a96ca4-7d21-41e2-8cc6-2275f561d821 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:27.784018 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-29a96ca4-7d21-41e2-8cc6-2275f561d821 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:27.784018 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-29a96ca4-7d21-41e2-8cc6-2275f561d821 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:27.930444 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-29a96ca4-7d21-41e2-8cc6-2275f561d821 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:27.937992 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-29a96ca4-7d21-41e2-8cc6-2275f561d821 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1500 microversion: 2.1 time: 0.169527 May 13 17:30:27.938564 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 324/640] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:27 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1500 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:27.955356 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d2ba9038-d7fe-409e-b169-619db5b1e54d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4eed60bd-703b-4f58-b523-9306c7791cd7"}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:30:27.956550 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d2ba9038-d7fe-409e-b169-619db5b1e54d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:27.963613 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d2ba9038-d7fe-409e-b169-619db5b1e54d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:27.964359 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d2ba9038-d7fe-409e-b169-619db5b1e54d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:27.965152 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d2ba9038-d7fe-409e-b169-619db5b1e54d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:27.966420 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d2ba9038-d7fe-409e-b169-619db5b1e54d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:28.000894 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-d2ba9038-d7fe-409e-b169-619db5b1e54d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] HTTP exception thrown: Cannot 'attach_volume' instance ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 while it is in vm_state rescued May 13 17:30:28.002622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d2ba9038-d7fe-409e-b169-619db5b1e54d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Request method failure captured: May 13 17:30:28.002622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: POST /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58/os-volume_attachments HTTP/1.1 May 13 17:30:28.002622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:30:28.002622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:30:28.002622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:30:28.002622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 74 May 13 17:30:28.002622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:30:28.002622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:30:28.002622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:30:28.002622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:30:28.002622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpVDPQ2EZlknyXEVYSbq1zYoA7qgi4TwOnKp1PCBXIVh9BXUHZ-NHURPOT1kGG7ilrBqfjIrle9-DF8hvEreUoI2Wl7a2ReyAgBImyd5i31N1LSELowfKgHaob5uflDcPzm1aA4ceGxUsDXZlHEatd8eQnnzECiIdnl5V_fwiM8ou84 May 13 17:30:28.002622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:30:28.002622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:30:28.002622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:30:28.002622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:30:28.002622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:30:28.002622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:30:28.002622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: 27832590c00f47b7b09c343e892f310a May 13 17:30:28.002622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1094369910 May 13 17:30:28.002622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:30:28.002622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:30:28.004277 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/27832590c00f47b7b09c343e892f310a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/27832590c00f47b7b09c343e892f310a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_27832590c00f47b7b09c343e892f310a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/27832590c00f47b7b09c343e892f310a"}]}] May 13 17:30:28.004277 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1094369910 May 13 17:30:28.004277 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: 27832590c00f47b7b09c343e892f310a May 13 17:30:28.004277 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1094369910 May 13 17:30:28.004277 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-ServerRescueNegativeTestJSON-1094369910-project May 13 17:30:28.004277 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:30:28.004277 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:30:28.004277 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: a0294c57ba3f41bc8cf2cac294bb678c May 13 17:30:28.004277 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1094369910-project May 13 17:30:28.004277 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: May 13 17:30:28.004277 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {"volumeAttachment": {"volumeId": "4eed60bd-703b-4f58-b523-9306c7791cd7"}} May 13 17:30:28.004277 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: > May 13 17:30:28.005216 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Cannot 'attach_volume' instance ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 while it is in vm_state rescued May 13 17:30:28.005216 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'server_id': 'ee92d4ec-0b6a-4fae-8b6c-eaf330781f58', 'body': {'volumeAttachment': {'volumeId': '4eed60bd-703b-4f58-b523-9306c7791cd7'}}} May 13 17:30:28.005216 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:30:28.005216 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:30:28.005216 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 13 17:30:28.005216 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 13 17:30:28.005216 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 17:30:28.005216 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 17:30:28.005216 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 13 17:30:28.005216 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 13 17:30:28.005216 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 13 17:30:28.005216 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:30:28.005216 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:30:28.005216 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:30:28.005216 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:30:28.005216 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:30:28.005216 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:30:28.005216 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:30:28.005216 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:30:28.006703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:30:28.006703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:30:28.006703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 17:30:28.006703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 17:30:28.006703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 17:30:28.006703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 17:30:28.006703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 17:30:28.006703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 17:30:28.006703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 13 17:30:28.006703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 13 17:30:28.006703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 13 17:30:28.006703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 13 17:30:28.006703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 while it is in vm_state rescued May 13 17:30:28.006703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:30:28.006703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:30:28.006703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:30:28.006703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:30:28.006703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:30:28.006703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:30:28.008137 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:30:28.008137 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:30:28.008137 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 while it is in vm_state rescued May 13 17:30:28.008137 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:30:28.008137 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d2ba9038-d7fe-409e-b169-619db5b1e54d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Returning 409 to user: Cannot 'attach_volume' instance ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 while it is in vm_state rescued {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:30:28.008137 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d2ba9038-d7fe-409e-b169-619db5b1e54d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "POST /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.053050 May 13 17:30:28.008137 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 317/641] 10.222.0.64 () {60 vars in 1322 bytes} [Fri May 13 17:30:27 2022] POST /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58/os-volume_attachments => generated 152 bytes in 54 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 13 17:30:28.013133 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-df43127c-7ce8-4194-9bf8-7b5453033e2b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:30:28.013665 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-df43127c-7ce8-4194-9bf8-7b5453033e2b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:28.021354 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-df43127c-7ce8-4194-9bf8-7b5453033e2b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:28.021955 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-df43127c-7ce8-4194-9bf8-7b5453033e2b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:28.022974 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-df43127c-7ce8-4194-9bf8-7b5453033e2b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:28.023635 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-df43127c-7ce8-4194-9bf8-7b5453033e2b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:28.170956 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-718d7d99-090c-4bb3-a35e-1c46927955de tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:28.171651 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-718d7d99-090c-4bb3-a35e-1c46927955de tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:28.180282 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-718d7d99-090c-4bb3-a35e-1c46927955de tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:28.184086 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-718d7d99-090c-4bb3-a35e-1c46927955de tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:28.184086 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-718d7d99-090c-4bb3-a35e-1c46927955de tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:28.184086 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-718d7d99-090c-4bb3-a35e-1c46927955de tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:28.327509 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-718d7d99-090c-4bb3-a35e-1c46927955de tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:28.332802 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-df43127c-7ce8-4194-9bf8-7b5453033e2b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "POST /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58/action" status: 202 len: 0 microversion: 2.1 time: 0.320008 May 13 17:30:28.332802 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 325/642] 10.222.0.64 () {60 vars in 1277 bytes} [Fri May 13 17:30:28 2022] POST /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58/action => generated 0 bytes in 322 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:30:28.338965 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-718d7d99-090c-4bb3-a35e-1c46927955de tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.171957 May 13 17:30:28.339921 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 318/643] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:28 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:28.341308 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-99dee724-a61f-48d5-a42d-3151f883a604 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:28.342084 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-99dee724-a61f-48d5-a42d-3151f883a604 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:28.349331 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-99dee724-a61f-48d5-a42d-3151f883a604 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:28.349868 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-99dee724-a61f-48d5-a42d-3151f883a604 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:28.350851 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-99dee724-a61f-48d5-a42d-3151f883a604 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:28.351164 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-99dee724-a61f-48d5-a42d-3151f883a604 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:28.433211 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a607637b-7c7b-4b56-bc1a-38d9a2707c37 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:28.433897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a607637b-7c7b-4b56-bc1a-38d9a2707c37 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:28.443399 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a607637b-7c7b-4b56-bc1a-38d9a2707c37 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:28.443894 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a607637b-7c7b-4b56-bc1a-38d9a2707c37 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:28.444998 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a607637b-7c7b-4b56-bc1a-38d9a2707c37 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:28.445452 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a607637b-7c7b-4b56-bc1a-38d9a2707c37 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:28.503705 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-99dee724-a61f-48d5-a42d-3151f883a604 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:28.512313 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-99dee724-a61f-48d5-a42d-3151f883a604 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1508 microversion: 2.1 time: 0.175507 May 13 17:30:28.513274 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 326/644] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:28 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:28.594357 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a607637b-7c7b-4b56-bc1a-38d9a2707c37 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:28.602703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a607637b-7c7b-4b56-bc1a-38d9a2707c37 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.173398 May 13 17:30:28.603371 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 319/645] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:28 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:28.631632 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5ae11bc2-39de-460c-abee-f0454a20a869 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:28.632241 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5ae11bc2-39de-460c-abee-f0454a20a869 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:28.638156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5ae11bc2-39de-460c-abee-f0454a20a869 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:28.638604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5ae11bc2-39de-460c-abee-f0454a20a869 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:28.639437 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5ae11bc2-39de-460c-abee-f0454a20a869 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:28.639884 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5ae11bc2-39de-460c-abee-f0454a20a869 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:28.778002 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5ae11bc2-39de-460c-abee-f0454a20a869 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:28.786292 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5ae11bc2-39de-460c-abee-f0454a20a869 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:28.787907 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5ae11bc2-39de-460c-abee-f0454a20a869 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:28.789155 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5ae11bc2-39de-460c-abee-f0454a20a869 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.161424 May 13 17:30:28.789755 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 327/646] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:28 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:30:29.362070 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-20c7ebef-3df8-4c44-81c4-f3602d98852d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:29.362711 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-20c7ebef-3df8-4c44-81c4-f3602d98852d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:29.370170 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-20c7ebef-3df8-4c44-81c4-f3602d98852d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:29.370920 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-20c7ebef-3df8-4c44-81c4-f3602d98852d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:29.372062 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-20c7ebef-3df8-4c44-81c4-f3602d98852d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:29.372606 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-20c7ebef-3df8-4c44-81c4-f3602d98852d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:29.506581 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-20c7ebef-3df8-4c44-81c4-f3602d98852d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:29.513873 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-20c7ebef-3df8-4c44-81c4-f3602d98852d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.158669 May 13 17:30:29.514649 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 320/647] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:29 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:29.529791 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1c0a808a-db17-4665-8a1d-84f14e104f80 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:29.530560 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1c0a808a-db17-4665-8a1d-84f14e104f80 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:29.538501 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1c0a808a-db17-4665-8a1d-84f14e104f80 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:29.538954 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1c0a808a-db17-4665-8a1d-84f14e104f80 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:29.539766 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1c0a808a-db17-4665-8a1d-84f14e104f80 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:29.540204 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1c0a808a-db17-4665-8a1d-84f14e104f80 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:29.624361 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-107d6762-4dce-450d-b832-8508eba57a51 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:29.624971 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-107d6762-4dce-450d-b832-8508eba57a51 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:29.631539 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-107d6762-4dce-450d-b832-8508eba57a51 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:29.632372 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-107d6762-4dce-450d-b832-8508eba57a51 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:29.634963 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-107d6762-4dce-450d-b832-8508eba57a51 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:29.635442 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-107d6762-4dce-450d-b832-8508eba57a51 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:29.684390 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1c0a808a-db17-4665-8a1d-84f14e104f80 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:29.697064 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1c0a808a-db17-4665-8a1d-84f14e104f80 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1508 microversion: 2.1 time: 0.170957 May 13 17:30:29.697839 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 328/648] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:29 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:29.788424 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-107d6762-4dce-450d-b832-8508eba57a51 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:29.796603 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-107d6762-4dce-450d-b832-8508eba57a51 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.180208 May 13 17:30:29.797326 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 321/649] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:29 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:29.808226 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5591f57d-7b2e-4938-aa13-c5cb95bf7450 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:29.808910 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5591f57d-7b2e-4938-aa13-c5cb95bf7450 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:29.815078 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5591f57d-7b2e-4938-aa13-c5cb95bf7450 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:29.815591 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5591f57d-7b2e-4938-aa13-c5cb95bf7450 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:29.816480 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5591f57d-7b2e-4938-aa13-c5cb95bf7450 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:29.816924 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5591f57d-7b2e-4938-aa13-c5cb95bf7450 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:29.951680 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5591f57d-7b2e-4938-aa13-c5cb95bf7450 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:29.961221 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5591f57d-7b2e-4938-aa13-c5cb95bf7450 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:29.962727 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5591f57d-7b2e-4938-aa13-c5cb95bf7450 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:29.963923 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5591f57d-7b2e-4938-aa13-c5cb95bf7450 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.159619 May 13 17:30:29.964486 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 329/650] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:29 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:30:30.531167 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f43c18f2-6a57-4510-9a19-3ef3327de991 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:30.531821 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-f43c18f2-6a57-4510-9a19-3ef3327de991 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:30.538392 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f43c18f2-6a57-4510-9a19-3ef3327de991 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:30.538776 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f43c18f2-6a57-4510-9a19-3ef3327de991 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:30.539590 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f43c18f2-6a57-4510-9a19-3ef3327de991 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:30.540035 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f43c18f2-6a57-4510-9a19-3ef3327de991 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:30.682324 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f43c18f2-6a57-4510-9a19-3ef3327de991 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:30.695679 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f43c18f2-6a57-4510-9a19-3ef3327de991 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.168536 May 13 17:30:30.699193 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 322/651] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:30 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:30.719970 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-86df6ab8-71ee-4e54-b5d1-f87694954349 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:30.720514 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-86df6ab8-71ee-4e54-b5d1-f87694954349 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:30.731699 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-86df6ab8-71ee-4e54-b5d1-f87694954349 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:30.731993 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-86df6ab8-71ee-4e54-b5d1-f87694954349 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:30.732818 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-86df6ab8-71ee-4e54-b5d1-f87694954349 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:30.733270 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-86df6ab8-71ee-4e54-b5d1-f87694954349 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:30.813862 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a88ef152-2af1-4906-8f47-5d72ebd81795 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:30.814395 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a88ef152-2af1-4906-8f47-5d72ebd81795 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:30.822152 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a88ef152-2af1-4906-8f47-5d72ebd81795 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:30.822643 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a88ef152-2af1-4906-8f47-5d72ebd81795 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:30.823508 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a88ef152-2af1-4906-8f47-5d72ebd81795 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:30.824022 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a88ef152-2af1-4906-8f47-5d72ebd81795 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:30.882522 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-86df6ab8-71ee-4e54-b5d1-f87694954349 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:30.884203 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-86df6ab8-71ee-4e54-b5d1-f87694954349 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1508 microversion: 2.1 time: 0.168128 May 13 17:30:30.885010 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 330/652] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:30 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1508 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:30.963614 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a88ef152-2af1-4906-8f47-5d72ebd81795 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:30.971590 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a88ef152-2af1-4906-8f47-5d72ebd81795 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.161102 May 13 17:30:30.972467 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 323/653] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:30 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:30.983601 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-26e4a597-87e6-46ab-8bcb-10f6f370e6a3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:30.984219 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-26e4a597-87e6-46ab-8bcb-10f6f370e6a3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:30.994040 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-26e4a597-87e6-46ab-8bcb-10f6f370e6a3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:30.994040 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-26e4a597-87e6-46ab-8bcb-10f6f370e6a3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:30.994040 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-26e4a597-87e6-46ab-8bcb-10f6f370e6a3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:30.994040 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-26e4a597-87e6-46ab-8bcb-10f6f370e6a3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:31.133832 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-26e4a597-87e6-46ab-8bcb-10f6f370e6a3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:31.142186 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-26e4a597-87e6-46ab-8bcb-10f6f370e6a3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:31.144210 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-26e4a597-87e6-46ab-8bcb-10f6f370e6a3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:31.145392 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-26e4a597-87e6-46ab-8bcb-10f6f370e6a3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.165735 May 13 17:30:31.145950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 331/654] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:30 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:30:31.713888 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3e862b66-740c-4e1b-b936-93eefb35ad53 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:31.714584 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3e862b66-740c-4e1b-b936-93eefb35ad53 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:31.721404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3e862b66-740c-4e1b-b936-93eefb35ad53 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:31.722088 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3e862b66-740c-4e1b-b936-93eefb35ad53 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:31.723038 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3e862b66-740c-4e1b-b936-93eefb35ad53 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:31.723630 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3e862b66-740c-4e1b-b936-93eefb35ad53 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:31.862272 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3e862b66-740c-4e1b-b936-93eefb35ad53 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:31.869869 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3e862b66-740c-4e1b-b936-93eefb35ad53 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.159904 May 13 17:30:31.873051 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 324/655] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:31 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:31.902273 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-37255e52-4b20-40e0-969a-274cb0276282 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:31.910732 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-37255e52-4b20-40e0-969a-274cb0276282 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:31.912350 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-37255e52-4b20-40e0-969a-274cb0276282 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:31.912897 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-37255e52-4b20-40e0-969a-274cb0276282 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:31.913749 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-37255e52-4b20-40e0-969a-274cb0276282 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:31.914336 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-37255e52-4b20-40e0-969a-274cb0276282 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:31.990038 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-8604754c-0f7b-44e0-8a36-3f3e1e3746d2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:31.991268 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-8604754c-0f7b-44e0-8a36-3f3e1e3746d2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:31.997858 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8604754c-0f7b-44e0-8a36-3f3e1e3746d2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:31.998311 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8604754c-0f7b-44e0-8a36-3f3e1e3746d2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:31.999442 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8604754c-0f7b-44e0-8a36-3f3e1e3746d2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:31.999945 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8604754c-0f7b-44e0-8a36-3f3e1e3746d2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:32.063979 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-37255e52-4b20-40e0-969a-274cb0276282 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:32.072184 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-37255e52-4b20-40e0-969a-274cb0276282 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1508 microversion: 2.1 time: 0.174689 May 13 17:30:32.074057 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 332/656] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:31 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:32.151507 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-8604754c-0f7b-44e0-8a36-3f3e1e3746d2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:32.159281 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-8604754c-0f7b-44e0-8a36-3f3e1e3746d2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.173822 May 13 17:30:32.160024 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 325/657] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:31 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:32.167037 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-81cc0400-516c-419f-9501-b13ba76b1a87 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:32.167816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-81cc0400-516c-419f-9501-b13ba76b1a87 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:32.176896 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-81cc0400-516c-419f-9501-b13ba76b1a87 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:32.177680 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-81cc0400-516c-419f-9501-b13ba76b1a87 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:32.178526 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-81cc0400-516c-419f-9501-b13ba76b1a87 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:32.179017 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-81cc0400-516c-419f-9501-b13ba76b1a87 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:32.313671 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-81cc0400-516c-419f-9501-b13ba76b1a87 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:32.322026 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-81cc0400-516c-419f-9501-b13ba76b1a87 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:32.323606 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-81cc0400-516c-419f-9501-b13ba76b1a87 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:32.324800 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-81cc0400-516c-419f-9501-b13ba76b1a87 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.164962 May 13 17:30:32.325373 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 333/658] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:32 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:30:32.888742 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a71c66e6-6725-4032-8162-c15defbe8838 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:32.889455 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a71c66e6-6725-4032-8162-c15defbe8838 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:32.896069 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a71c66e6-6725-4032-8162-c15defbe8838 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:32.896601 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a71c66e6-6725-4032-8162-c15defbe8838 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:32.897457 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a71c66e6-6725-4032-8162-c15defbe8838 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:32.897952 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a71c66e6-6725-4032-8162-c15defbe8838 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:33.034708 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a71c66e6-6725-4032-8162-c15defbe8838 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:33.042382 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a71c66e6-6725-4032-8162-c15defbe8838 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.157516 May 13 17:30:33.043002 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 326/659] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:32 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:33.089569 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-88f87cc5-a45e-4c32-8ef9-5052418c59e5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:33.090188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-88f87cc5-a45e-4c32-8ef9-5052418c59e5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:33.097035 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-88f87cc5-a45e-4c32-8ef9-5052418c59e5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:33.097494 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-88f87cc5-a45e-4c32-8ef9-5052418c59e5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:33.098266 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-88f87cc5-a45e-4c32-8ef9-5052418c59e5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:33.098742 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-88f87cc5-a45e-4c32-8ef9-5052418c59e5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:33.176698 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-cbadfe25-e395-4821-9432-4ac8b0ffc413 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:33.178154 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-cbadfe25-e395-4821-9432-4ac8b0ffc413 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:33.185958 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cbadfe25-e395-4821-9432-4ac8b0ffc413 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:33.186474 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cbadfe25-e395-4821-9432-4ac8b0ffc413 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:33.187248 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cbadfe25-e395-4821-9432-4ac8b0ffc413 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:33.187695 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cbadfe25-e395-4821-9432-4ac8b0ffc413 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:33.236834 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-88f87cc5-a45e-4c32-8ef9-5052418c59e5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:33.245205 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-88f87cc5-a45e-4c32-8ef9-5052418c59e5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1508 microversion: 2.1 time: 0.159567 May 13 17:30:33.246034 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 334/660] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:33 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1508 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:33.324137 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-cbadfe25-e395-4821-9432-4ac8b0ffc413 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:33.332044 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-cbadfe25-e395-4821-9432-4ac8b0ffc413 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.159239 May 13 17:30:33.334731 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 327/661] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:33 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:33.343347 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-60f2ba52-757e-473f-ac49-b4b18d800b9d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:33.344071 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-60f2ba52-757e-473f-ac49-b4b18d800b9d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:33.351224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-60f2ba52-757e-473f-ac49-b4b18d800b9d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:33.351683 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-60f2ba52-757e-473f-ac49-b4b18d800b9d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:33.352451 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-60f2ba52-757e-473f-ac49-b4b18d800b9d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:33.352888 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-60f2ba52-757e-473f-ac49-b4b18d800b9d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:33.498947 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-60f2ba52-757e-473f-ac49-b4b18d800b9d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:33.515396 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-60f2ba52-757e-473f-ac49-b4b18d800b9d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:33.515396 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-60f2ba52-757e-473f-ac49-b4b18d800b9d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:33.515396 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-60f2ba52-757e-473f-ac49-b4b18d800b9d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.170627 May 13 17:30:33.515703 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 335/662] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:33 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:30:34.059355 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-401e9db1-322f-40ca-9dc3-7529e3c9c0bd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:34.060541 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-401e9db1-322f-40ca-9dc3-7529e3c9c0bd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:34.067899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-401e9db1-322f-40ca-9dc3-7529e3c9c0bd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:34.068647 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-401e9db1-322f-40ca-9dc3-7529e3c9c0bd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:34.069428 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-401e9db1-322f-40ca-9dc3-7529e3c9c0bd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:34.070001 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-401e9db1-322f-40ca-9dc3-7529e3c9c0bd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:34.210335 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-401e9db1-322f-40ca-9dc3-7529e3c9c0bd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:34.217821 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-401e9db1-322f-40ca-9dc3-7529e3c9c0bd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.162520 May 13 17:30:34.218393 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 328/663] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:34 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:34.262259 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5db9fa3d-b5ea-413f-a1ad-867ba4ed9943 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:34.262782 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5db9fa3d-b5ea-413f-a1ad-867ba4ed9943 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:34.270297 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5db9fa3d-b5ea-413f-a1ad-867ba4ed9943 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:34.271370 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5db9fa3d-b5ea-413f-a1ad-867ba4ed9943 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:34.272181 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5db9fa3d-b5ea-413f-a1ad-867ba4ed9943 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:34.272620 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5db9fa3d-b5ea-413f-a1ad-867ba4ed9943 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:34.350830 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a5cbdc58-2ad9-4ec1-a16c-235cbcdd32b1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:34.352716 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a5cbdc58-2ad9-4ec1-a16c-235cbcdd32b1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:34.362760 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a5cbdc58-2ad9-4ec1-a16c-235cbcdd32b1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:34.362760 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a5cbdc58-2ad9-4ec1-a16c-235cbcdd32b1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:34.362760 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a5cbdc58-2ad9-4ec1-a16c-235cbcdd32b1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:34.362760 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a5cbdc58-2ad9-4ec1-a16c-235cbcdd32b1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:34.418781 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5db9fa3d-b5ea-413f-a1ad-867ba4ed9943 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:34.427372 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5db9fa3d-b5ea-413f-a1ad-867ba4ed9943 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1508 microversion: 2.1 time: 0.168506 May 13 17:30:34.428227 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 336/664] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:34 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:34.505820 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a5cbdc58-2ad9-4ec1-a16c-235cbcdd32b1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:34.513003 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a5cbdc58-2ad9-4ec1-a16c-235cbcdd32b1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.165984 May 13 17:30:34.513521 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 329/665] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:34 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:34.527523 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9c7d4709-f1f7-4bf4-a3fb-f1bd2df51e68 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:34.528137 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9c7d4709-f1f7-4bf4-a3fb-f1bd2df51e68 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:34.534048 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9c7d4709-f1f7-4bf4-a3fb-f1bd2df51e68 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:34.534499 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9c7d4709-f1f7-4bf4-a3fb-f1bd2df51e68 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:34.535292 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9c7d4709-f1f7-4bf4-a3fb-f1bd2df51e68 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:34.535728 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9c7d4709-f1f7-4bf4-a3fb-f1bd2df51e68 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:34.677987 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9c7d4709-f1f7-4bf4-a3fb-f1bd2df51e68 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:34.689266 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9c7d4709-f1f7-4bf4-a3fb-f1bd2df51e68 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:34.690863 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9c7d4709-f1f7-4bf4-a3fb-f1bd2df51e68 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:34.692191 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9c7d4709-f1f7-4bf4-a3fb-f1bd2df51e68 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.168714 May 13 17:30:34.692787 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 337/666] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:34 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:30:35.236129 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1a2e7c16-e6fb-4bbc-8682-35901c52d59e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:35.237449 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-1a2e7c16-e6fb-4bbc-8682-35901c52d59e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:35.244092 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1a2e7c16-e6fb-4bbc-8682-35901c52d59e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:35.244566 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1a2e7c16-e6fb-4bbc-8682-35901c52d59e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:35.245534 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1a2e7c16-e6fb-4bbc-8682-35901c52d59e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:35.245962 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1a2e7c16-e6fb-4bbc-8682-35901c52d59e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:35.382497 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-1a2e7c16-e6fb-4bbc-8682-35901c52d59e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:35.389904 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-1a2e7c16-e6fb-4bbc-8682-35901c52d59e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.158684 May 13 17:30:35.390481 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 330/667] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:35 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:35.444188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-eeec8fc5-b85e-45a7-bdea-72519961fbce tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:35.444783 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-eeec8fc5-b85e-45a7-bdea-72519961fbce tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:35.451027 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eeec8fc5-b85e-45a7-bdea-72519961fbce tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:35.451509 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eeec8fc5-b85e-45a7-bdea-72519961fbce tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:35.452269 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eeec8fc5-b85e-45a7-bdea-72519961fbce tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:35.452701 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eeec8fc5-b85e-45a7-bdea-72519961fbce tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:35.531749 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-0e329b2d-e01b-49fb-8034-ecafbe73219d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:35.533049 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-0e329b2d-e01b-49fb-8034-ecafbe73219d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:35.546673 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0e329b2d-e01b-49fb-8034-ecafbe73219d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:35.547158 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0e329b2d-e01b-49fb-8034-ecafbe73219d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:35.548075 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0e329b2d-e01b-49fb-8034-ecafbe73219d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:35.548528 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0e329b2d-e01b-49fb-8034-ecafbe73219d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:35.590003 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-eeec8fc5-b85e-45a7-bdea-72519961fbce tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:35.598036 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-eeec8fc5-b85e-45a7-bdea-72519961fbce tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1508 microversion: 2.1 time: 0.157629 May 13 17:30:35.599480 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 338/668] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:35 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:35.691684 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0e329b2d-e01b-49fb-8034-ecafbe73219d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:35.704133 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-0e329b2d-e01b-49fb-8034-ecafbe73219d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.178216 May 13 17:30:35.711366 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9a7d8a0b-6bfa-4a63-a915-c014591f6a24 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:35.711972 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9a7d8a0b-6bfa-4a63-a915-c014591f6a24 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:35.718069 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a7d8a0b-6bfa-4a63-a915-c014591f6a24 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:35.718523 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a7d8a0b-6bfa-4a63-a915-c014591f6a24 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:35.719496 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a7d8a0b-6bfa-4a63-a915-c014591f6a24 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:35.719711 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 331/669] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:35 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:35.719935 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a7d8a0b-6bfa-4a63-a915-c014591f6a24 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:35.853595 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9a7d8a0b-6bfa-4a63-a915-c014591f6a24 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:35.862894 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9a7d8a0b-6bfa-4a63-a915-c014591f6a24 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:35.864470 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9a7d8a0b-6bfa-4a63-a915-c014591f6a24 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:35.885531 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9a7d8a0b-6bfa-4a63-a915-c014591f6a24 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.158169 May 13 17:30:35.885531 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 339/670] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:35 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:30:36.406638 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6a293b66-76ed-4ae3-9c1b-c2b37b63eb8e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:36.407348 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6a293b66-76ed-4ae3-9c1b-c2b37b63eb8e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:36.413840 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6a293b66-76ed-4ae3-9c1b-c2b37b63eb8e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:36.414294 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6a293b66-76ed-4ae3-9c1b-c2b37b63eb8e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:36.415060 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6a293b66-76ed-4ae3-9c1b-c2b37b63eb8e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:36.415526 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6a293b66-76ed-4ae3-9c1b-c2b37b63eb8e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:36.562925 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6a293b66-76ed-4ae3-9c1b-c2b37b63eb8e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:36.570782 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6a293b66-76ed-4ae3-9c1b-c2b37b63eb8e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.167974 May 13 17:30:36.580447 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 332/671] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:36 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:36.617922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-07f0bc88-aab0-4fbc-bda0-77311ff41cc1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:36.618587 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-07f0bc88-aab0-4fbc-bda0-77311ff41cc1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:36.624800 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-07f0bc88-aab0-4fbc-bda0-77311ff41cc1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:36.625257 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-07f0bc88-aab0-4fbc-bda0-77311ff41cc1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:36.626037 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-07f0bc88-aab0-4fbc-bda0-77311ff41cc1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:36.626476 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-07f0bc88-aab0-4fbc-bda0-77311ff41cc1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:36.731502 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-8f50864d-d063-410d-a521-90e49bbf7118 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:36.732215 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-8f50864d-d063-410d-a521-90e49bbf7118 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:36.738165 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8f50864d-d063-410d-a521-90e49bbf7118 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:36.738628 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8f50864d-d063-410d-a521-90e49bbf7118 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:36.739422 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8f50864d-d063-410d-a521-90e49bbf7118 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:36.741589 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8f50864d-d063-410d-a521-90e49bbf7118 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:36.756979 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-07f0bc88-aab0-4fbc-bda0-77311ff41cc1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:36.765291 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-07f0bc88-aab0-4fbc-bda0-77311ff41cc1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1508 microversion: 2.1 time: 0.152432 May 13 17:30:36.765879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 340/672] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:36 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:36.870787 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-8f50864d-d063-410d-a521-90e49bbf7118 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:36.877986 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-8f50864d-d063-410d-a521-90e49bbf7118 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.150690 May 13 17:30:36.878553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 333/673] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:36 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:36.892733 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9b022f35-e141-4ba6-aad6-e12a88ae0f6a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:36.893419 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9b022f35-e141-4ba6-aad6-e12a88ae0f6a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:36.900082 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9b022f35-e141-4ba6-aad6-e12a88ae0f6a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:36.913091 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9b022f35-e141-4ba6-aad6-e12a88ae0f6a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:36.913091 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9b022f35-e141-4ba6-aad6-e12a88ae0f6a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:36.913091 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9b022f35-e141-4ba6-aad6-e12a88ae0f6a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:37.028605 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9b022f35-e141-4ba6-aad6-e12a88ae0f6a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:37.036326 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9b022f35-e141-4ba6-aad6-e12a88ae0f6a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:37.037817 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9b022f35-e141-4ba6-aad6-e12a88ae0f6a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:37.038974 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9b022f35-e141-4ba6-aad6-e12a88ae0f6a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.150322 May 13 17:30:37.039570 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 341/674] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:36 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:30:37.588860 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-0d36a38a-fc87-4393-a96f-fecf2725b995 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:37.589504 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-0d36a38a-fc87-4393-a96f-fecf2725b995 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:37.597017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0d36a38a-fc87-4393-a96f-fecf2725b995 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:37.597473 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0d36a38a-fc87-4393-a96f-fecf2725b995 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:37.598257 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0d36a38a-fc87-4393-a96f-fecf2725b995 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:37.598699 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0d36a38a-fc87-4393-a96f-fecf2725b995 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:37.735737 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0d36a38a-fc87-4393-a96f-fecf2725b995 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:37.748620 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-0d36a38a-fc87-4393-a96f-fecf2725b995 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.163810 May 13 17:30:37.749197 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 334/675] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:37 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:37.781953 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3c29215e-c0b5-4449-a20c-790f2fe2533f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:37.782506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3c29215e-c0b5-4449-a20c-790f2fe2533f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:37.788676 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3c29215e-c0b5-4449-a20c-790f2fe2533f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:37.789132 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3c29215e-c0b5-4449-a20c-790f2fe2533f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:37.789907 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3c29215e-c0b5-4449-a20c-790f2fe2533f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:37.791262 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3c29215e-c0b5-4449-a20c-790f2fe2533f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:37.895803 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-bebaa751-857f-4961-91b2-37f6adb384ae tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:37.897221 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-bebaa751-857f-4961-91b2-37f6adb384ae tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:37.903295 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bebaa751-857f-4961-91b2-37f6adb384ae tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:37.903737 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bebaa751-857f-4961-91b2-37f6adb384ae tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:37.904497 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bebaa751-857f-4961-91b2-37f6adb384ae tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:37.904926 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bebaa751-857f-4961-91b2-37f6adb384ae tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:37.931637 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3c29215e-c0b5-4449-a20c-790f2fe2533f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:37.939863 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3c29215e-c0b5-4449-a20c-790f2fe2533f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1508 microversion: 2.1 time: 0.161615 May 13 17:30:37.950387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 342/676] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:37 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1508 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:38.056786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-bebaa751-857f-4961-91b2-37f6adb384ae tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:38.057869 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f8c85906-cb41-4eb5-bd71-cda19fa1ccca tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:38.058487 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f8c85906-cb41-4eb5-bd71-cda19fa1ccca tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:38.064505 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f8c85906-cb41-4eb5-bd71-cda19fa1ccca tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:38.070123 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f8c85906-cb41-4eb5-bd71-cda19fa1ccca tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:38.070317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-bebaa751-857f-4961-91b2-37f6adb384ae tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.173877 May 13 17:30:38.070317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 335/677] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:37 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:38.070520 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f8c85906-cb41-4eb5-bd71-cda19fa1ccca tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:38.070520 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f8c85906-cb41-4eb5-bd71-cda19fa1ccca tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:38.193779 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f8c85906-cb41-4eb5-bd71-cda19fa1ccca tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:38.201394 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f8c85906-cb41-4eb5-bd71-cda19fa1ccca tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:38.202866 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f8c85906-cb41-4eb5-bd71-cda19fa1ccca tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:38.204035 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f8c85906-cb41-4eb5-bd71-cda19fa1ccca tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.150099 May 13 17:30:38.204590 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 343/678] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:38 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:30:38.768270 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-c9e43f19-960a-429a-ab77-e910ddd4772d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:38.768903 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-c9e43f19-960a-429a-ab77-e910ddd4772d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:38.775374 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c9e43f19-960a-429a-ab77-e910ddd4772d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:38.775816 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c9e43f19-960a-429a-ab77-e910ddd4772d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:38.776569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c9e43f19-960a-429a-ab77-e910ddd4772d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:38.776998 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c9e43f19-960a-429a-ab77-e910ddd4772d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:38.903707 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c9e43f19-960a-429a-ab77-e910ddd4772d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:38.911435 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-c9e43f19-960a-429a-ab77-e910ddd4772d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.146945 May 13 17:30:38.917454 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 336/679] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:38 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:38.957444 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f21537eb-21ad-45fd-8885-643c7b39b43b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:38.958116 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f21537eb-21ad-45fd-8885-643c7b39b43b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:38.964241 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f21537eb-21ad-45fd-8885-643c7b39b43b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:38.964692 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f21537eb-21ad-45fd-8885-643c7b39b43b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:38.965463 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f21537eb-21ad-45fd-8885-643c7b39b43b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:38.965906 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f21537eb-21ad-45fd-8885-643c7b39b43b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:39.081544 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-0acc58c4-f54a-4634-abb3-9e84756b0d3f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:39.082162 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-0acc58c4-f54a-4634-abb3-9e84756b0d3f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:39.088077 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0acc58c4-f54a-4634-abb3-9e84756b0d3f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:39.088524 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0acc58c4-f54a-4634-abb3-9e84756b0d3f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:39.089292 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0acc58c4-f54a-4634-abb3-9e84756b0d3f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:39.089721 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0acc58c4-f54a-4634-abb3-9e84756b0d3f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:39.092421 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f21537eb-21ad-45fd-8885-643c7b39b43b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:39.100058 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f21537eb-21ad-45fd-8885-643c7b39b43b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1508 microversion: 2.1 time: 0.146382 May 13 17:30:39.100717 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 344/680] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:38 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1508 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:39.216719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0acc58c4-f54a-4634-abb3-9e84756b0d3f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:39.221801 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4cfeb14f-8734-4b95-a976-b3955f2eceaf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:39.222405 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4cfeb14f-8734-4b95-a976-b3955f2eceaf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:39.224311 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-0acc58c4-f54a-4634-abb3-9e84756b0d3f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.146455 May 13 17:30:39.224891 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 337/681] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:39 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:39.228758 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4cfeb14f-8734-4b95-a976-b3955f2eceaf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:39.229205 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4cfeb14f-8734-4b95-a976-b3955f2eceaf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:39.229959 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4cfeb14f-8734-4b95-a976-b3955f2eceaf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:39.230405 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4cfeb14f-8734-4b95-a976-b3955f2eceaf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:39.356504 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4cfeb14f-8734-4b95-a976-b3955f2eceaf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:39.364376 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4cfeb14f-8734-4b95-a976-b3955f2eceaf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:39.365880 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4cfeb14f-8734-4b95-a976-b3955f2eceaf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:39.367722 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4cfeb14f-8734-4b95-a976-b3955f2eceaf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.149934 May 13 17:30:39.368314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 345/682] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:39 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:30:39.932195 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-63da2e2b-3e35-40e6-a78b-a5494aa19809 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:39.932808 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-63da2e2b-3e35-40e6-a78b-a5494aa19809 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:39.939293 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-63da2e2b-3e35-40e6-a78b-a5494aa19809 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:39.945837 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-63da2e2b-3e35-40e6-a78b-a5494aa19809 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:39.945837 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-63da2e2b-3e35-40e6-a78b-a5494aa19809 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:39.945837 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-63da2e2b-3e35-40e6-a78b-a5494aa19809 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:40.069482 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-63da2e2b-3e35-40e6-a78b-a5494aa19809 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:40.077214 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-63da2e2b-3e35-40e6-a78b-a5494aa19809 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.148740 May 13 17:30:40.077962 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 338/683] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:39 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:40.117363 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c8f4a94b-5b99-46df-9823-c9bb60f1fc7d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:40.117980 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c8f4a94b-5b99-46df-9823-c9bb60f1fc7d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:40.124261 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c8f4a94b-5b99-46df-9823-c9bb60f1fc7d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:40.124717 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c8f4a94b-5b99-46df-9823-c9bb60f1fc7d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:40.125480 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c8f4a94b-5b99-46df-9823-c9bb60f1fc7d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:40.125920 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c8f4a94b-5b99-46df-9823-c9bb60f1fc7d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:40.241366 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-adba4a9b-8c76-48c6-aa9a-6bc0fcd267f2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:40.242583 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-adba4a9b-8c76-48c6-aa9a-6bc0fcd267f2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:40.248591 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-adba4a9b-8c76-48c6-aa9a-6bc0fcd267f2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:40.249188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-adba4a9b-8c76-48c6-aa9a-6bc0fcd267f2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:40.249964 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-adba4a9b-8c76-48c6-aa9a-6bc0fcd267f2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:40.250401 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-adba4a9b-8c76-48c6-aa9a-6bc0fcd267f2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:40.251551 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c8f4a94b-5b99-46df-9823-c9bb60f1fc7d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:40.259893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c8f4a94b-5b99-46df-9823-c9bb60f1fc7d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1508 microversion: 2.1 time: 0.146342 May 13 17:30:40.260666 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 346/684] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:40 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1508 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:40.377358 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-adba4a9b-8c76-48c6-aa9a-6bc0fcd267f2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:40.385355 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-adba4a9b-8c76-48c6-aa9a-6bc0fcd267f2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.147817 May 13 17:30:40.385937 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 339/685] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:40 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:40.386450 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-14b091de-f515-459d-8f9a-f2dd6d5988bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:40.387067 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-14b091de-f515-459d-8f9a-f2dd6d5988bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:40.392904 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-14b091de-f515-459d-8f9a-f2dd6d5988bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:40.393351 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-14b091de-f515-459d-8f9a-f2dd6d5988bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:40.394119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-14b091de-f515-459d-8f9a-f2dd6d5988bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:40.394561 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-14b091de-f515-459d-8f9a-f2dd6d5988bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:40.529843 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-14b091de-f515-459d-8f9a-f2dd6d5988bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:40.537473 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-14b091de-f515-459d-8f9a-f2dd6d5988bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:40.538993 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-14b091de-f515-459d-8f9a-f2dd6d5988bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:40.546367 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-14b091de-f515-459d-8f9a-f2dd6d5988bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.158172 May 13 17:30:40.546367 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 347/686] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:40 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:30:41.094028 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6005848a-4cf0-40a0-829b-40252e034bf3 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:41.095412 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6005848a-4cf0-40a0-829b-40252e034bf3 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:41.105566 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6005848a-4cf0-40a0-829b-40252e034bf3 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:41.106258 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6005848a-4cf0-40a0-829b-40252e034bf3 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:41.108481 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6005848a-4cf0-40a0-829b-40252e034bf3 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:41.109177 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6005848a-4cf0-40a0-829b-40252e034bf3 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:41.255620 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6005848a-4cf0-40a0-829b-40252e034bf3 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:41.263490 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6005848a-4cf0-40a0-829b-40252e034bf3 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.173527 May 13 17:30:41.264246 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 340/687] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:41 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:41.276691 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e663efb2-f39f-48c2-9040-82196ac527db tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:41.277314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e663efb2-f39f-48c2-9040-82196ac527db tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:41.283981 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e663efb2-f39f-48c2-9040-82196ac527db tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:41.286165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e663efb2-f39f-48c2-9040-82196ac527db tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:41.286165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e663efb2-f39f-48c2-9040-82196ac527db tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:41.286165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e663efb2-f39f-48c2-9040-82196ac527db tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:41.402411 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7ed87a2e-6bc7-4123-9029-e90b3eae4271 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:41.403100 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7ed87a2e-6bc7-4123-9029-e90b3eae4271 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:41.409569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7ed87a2e-6bc7-4123-9029-e90b3eae4271 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:41.410002 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7ed87a2e-6bc7-4123-9029-e90b3eae4271 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:41.410995 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7ed87a2e-6bc7-4123-9029-e90b3eae4271 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:41.411486 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7ed87a2e-6bc7-4123-9029-e90b3eae4271 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:41.649043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7ed87a2e-6bc7-4123-9029-e90b3eae4271 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:41.661111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7ed87a2e-6bc7-4123-9029-e90b3eae4271 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.262390 May 13 17:30:41.662340 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 341/688] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:41 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:41.669102 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-0e1d076b-1cd6-4911-81bb-6139e43dd98e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:41.670340 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-0e1d076b-1cd6-4911-81bb-6139e43dd98e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:41.677248 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0e1d076b-1cd6-4911-81bb-6139e43dd98e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:41.677700 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0e1d076b-1cd6-4911-81bb-6139e43dd98e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:41.678687 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0e1d076b-1cd6-4911-81bb-6139e43dd98e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:41.679750 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0e1d076b-1cd6-4911-81bb-6139e43dd98e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:41.802976 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e663efb2-f39f-48c2-9040-82196ac527db tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:41.814307 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e663efb2-f39f-48c2-9040-82196ac527db tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1508 microversion: 2.1 time: 0.541754 May 13 17:30:41.815144 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 348/689] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:41 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1508 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:41.885377 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0e1d076b-1cd6-4911-81bb-6139e43dd98e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:41.893146 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0e1d076b-1cd6-4911-81bb-6139e43dd98e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:41.894655 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0e1d076b-1cd6-4911-81bb-6139e43dd98e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:41.896823 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-0e1d076b-1cd6-4911-81bb-6139e43dd98e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.232230 May 13 17:30:41.897393 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 342/690] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:41 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:30:42.281028 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8821959d-d326-4519-95f6-c0e39abf5c9a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:42.281635 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8821959d-d326-4519-95f6-c0e39abf5c9a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:42.287920 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8821959d-d326-4519-95f6-c0e39abf5c9a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:42.288872 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8821959d-d326-4519-95f6-c0e39abf5c9a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:42.289639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8821959d-d326-4519-95f6-c0e39abf5c9a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:42.290074 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8821959d-d326-4519-95f6-c0e39abf5c9a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:42.419928 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8821959d-d326-4519-95f6-c0e39abf5c9a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:42.428487 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8821959d-d326-4519-95f6-c0e39abf5c9a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.151242 May 13 17:30:42.438360 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 349/691] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:42 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:42.678314 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3ba45089-caf1-44f1-8257-316999878b13 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:42.679589 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3ba45089-caf1-44f1-8257-316999878b13 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:42.686138 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3ba45089-caf1-44f1-8257-316999878b13 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:42.686581 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3ba45089-caf1-44f1-8257-316999878b13 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:42.687569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3ba45089-caf1-44f1-8257-316999878b13 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:42.688124 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3ba45089-caf1-44f1-8257-316999878b13 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:42.836040 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3ba45089-caf1-44f1-8257-316999878b13 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:42.841899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f9f2cfe2-96a2-41a4-bf48-f121082ffb60 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:42.842577 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f9f2cfe2-96a2-41a4-bf48-f121082ffb60 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:42.844416 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3ba45089-caf1-44f1-8257-316999878b13 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.169606 May 13 17:30:42.849698 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f9f2cfe2-96a2-41a4-bf48-f121082ffb60 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:42.850152 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f9f2cfe2-96a2-41a4-bf48-f121082ffb60 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:42.851591 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f9f2cfe2-96a2-41a4-bf48-f121082ffb60 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:42.852026 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f9f2cfe2-96a2-41a4-bf48-f121082ffb60 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:42.854734 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 343/692] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:42 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:42.915760 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3623ce31-7946-48f0-829e-ef8f805a3301 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:42.916558 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3623ce31-7946-48f0-829e-ef8f805a3301 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:42.926674 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3623ce31-7946-48f0-829e-ef8f805a3301 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:42.927159 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3623ce31-7946-48f0-829e-ef8f805a3301 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:42.927954 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3623ce31-7946-48f0-829e-ef8f805a3301 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:42.928398 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3623ce31-7946-48f0-829e-ef8f805a3301 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:42.999378 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f9f2cfe2-96a2-41a4-bf48-f121082ffb60 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:43.006664 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f9f2cfe2-96a2-41a4-bf48-f121082ffb60 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1508 microversion: 2.1 time: 0.168860 May 13 17:30:43.008015 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 350/693] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:42 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:43.070270 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3623ce31-7946-48f0-829e-ef8f805a3301 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:43.078420 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3623ce31-7946-48f0-829e-ef8f805a3301 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:43.080057 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3623ce31-7946-48f0-829e-ef8f805a3301 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:43.081311 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3623ce31-7946-48f0-829e-ef8f805a3301 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.169448 May 13 17:30:43.081987 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 344/694] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:42 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:30:43.447104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a64ce471-8722-459f-93a8-c25ca5ad0cd4 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:43.448065 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a64ce471-8722-459f-93a8-c25ca5ad0cd4 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:43.454903 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a64ce471-8722-459f-93a8-c25ca5ad0cd4 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:43.455878 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a64ce471-8722-459f-93a8-c25ca5ad0cd4 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:43.456864 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a64ce471-8722-459f-93a8-c25ca5ad0cd4 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:43.457470 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a64ce471-8722-459f-93a8-c25ca5ad0cd4 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:43.609296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a64ce471-8722-459f-93a8-c25ca5ad0cd4 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:43.622128 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a64ce471-8722-459f-93a8-c25ca5ad0cd4 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.179714 May 13 17:30:43.622705 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 351/695] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:43 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:43.869508 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d9a0c1d1-edce-43bc-9e91-bf36a17a18e0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:43.869508 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d9a0c1d1-edce-43bc-9e91-bf36a17a18e0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:43.870171 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-8a8fc7de-d09e-4a09-9e24-cfb3d3aece82 req-7f7f84c7-c8f3-4563-b7f7-e31687190ecf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a310844-e208-4f17-a8c9-fd4db4acf00d", "name": "network-vif-plugged", "status": "completed", "tag": "f37d13dd-347a-41e2-8ca5-2b0f1df46c9c"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:30:43.875696 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d9a0c1d1-edce-43bc-9e91-bf36a17a18e0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:43.876170 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d9a0c1d1-edce-43bc-9e91-bf36a17a18e0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:43.876947 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d9a0c1d1-edce-43bc-9e91-bf36a17a18e0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:43.882507 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-8a8fc7de-d09e-4a09-9e24-cfb3d3aece82 req-7f7f84c7-c8f3-4563-b7f7-e31687190ecf service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:43.883357 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-8a8fc7de-d09e-4a09-9e24-cfb3d3aece82 req-7f7f84c7-c8f3-4563-b7f7-e31687190ecf service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:43.885027 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d9a0c1d1-edce-43bc-9e91-bf36a17a18e0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:43.903973 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-8a8fc7de-d09e-4a09-9e24-cfb3d3aece82 req-7f7f84c7-c8f3-4563-b7f7-e31687190ecf service nova] Creating event network-vif-plugged:f37d13dd-347a-41e2-8ca5-2b0f1df46c9c for instance 7a310844-e208-4f17-a8c9-fd4db4acf00d on hv-cinder-84178 May 13 17:30:43.921127 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-8a8fc7de-d09e-4a09-9e24-cfb3d3aece82 req-7f7f84c7-c8f3-4563-b7f7-e31687190ecf service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060410 May 13 17:30:43.921915 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 352/696] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:30:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:30:44.031005 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-983e4390-ad52-483d-abb0-f48b4ce11172 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:44.032913 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-983e4390-ad52-483d-abb0-f48b4ce11172 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:44.056154 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-983e4390-ad52-483d-abb0-f48b4ce11172 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:44.056550 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-983e4390-ad52-483d-abb0-f48b4ce11172 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:44.057535 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-983e4390-ad52-483d-abb0-f48b4ce11172 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:44.057903 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-983e4390-ad52-483d-abb0-f48b4ce11172 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:44.185828 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d9a0c1d1-edce-43bc-9e91-bf36a17a18e0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:44.197506 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d9a0c1d1-edce-43bc-9e91-bf36a17a18e0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1367 microversion: 2.1 time: 0.339318 May 13 17:30:44.198460 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 345/697] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:43 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1367 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:44.203560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-c502a297-8633-4960-be5a-502347a22c5d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:44.204804 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-c502a297-8633-4960-be5a-502347a22c5d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:44.215480 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c502a297-8633-4960-be5a-502347a22c5d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:44.216829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c502a297-8633-4960-be5a-502347a22c5d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:44.218169 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c502a297-8633-4960-be5a-502347a22c5d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:44.218823 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c502a297-8633-4960-be5a-502347a22c5d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:44.265220 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-983e4390-ad52-483d-abb0-f48b4ce11172 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:44.282601 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-983e4390-ad52-483d-abb0-f48b4ce11172 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1508 microversion: 2.1 time: 0.260292 May 13 17:30:44.284001 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 353/698] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:44 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1508 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:44.382624 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c502a297-8633-4960-be5a-502347a22c5d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:44.395098 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c502a297-8633-4960-be5a-502347a22c5d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:44.398942 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c502a297-8633-4960-be5a-502347a22c5d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:44.399071 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-c502a297-8633-4960-be5a-502347a22c5d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.199273 May 13 17:30:44.409774 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 346/699] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:44 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:30:44.643946 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1edce962-f014-4410-a664-2f603ce4f7d6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:44.645885 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1edce962-f014-4410-a664-2f603ce4f7d6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:44.661275 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1edce962-f014-4410-a664-2f603ce4f7d6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:44.662197 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1edce962-f014-4410-a664-2f603ce4f7d6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:44.663804 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1edce962-f014-4410-a664-2f603ce4f7d6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:44.664613 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1edce962-f014-4410-a664-2f603ce4f7d6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:44.862700 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1edce962-f014-4410-a664-2f603ce4f7d6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:44.873847 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1edce962-f014-4410-a664-2f603ce4f7d6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.237832 May 13 17:30:44.883803 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 354/700] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:44 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:45.214623 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f9c21028-a653-469a-abb9-1ce41dd24be8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:45.215367 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-f9c21028-a653-469a-abb9-1ce41dd24be8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:45.222726 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f9c21028-a653-469a-abb9-1ce41dd24be8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:45.223472 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f9c21028-a653-469a-abb9-1ce41dd24be8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:45.224480 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f9c21028-a653-469a-abb9-1ce41dd24be8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:45.225184 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f9c21028-a653-469a-abb9-1ce41dd24be8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:45.300464 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-60acf579-2480-497e-b820-eff57bdd7cd9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:45.301506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-60acf579-2480-497e-b820-eff57bdd7cd9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:45.310968 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-60acf579-2480-497e-b820-eff57bdd7cd9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:45.311471 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-60acf579-2480-497e-b820-eff57bdd7cd9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:45.313322 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-60acf579-2480-497e-b820-eff57bdd7cd9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:45.313322 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-60acf579-2480-497e-b820-eff57bdd7cd9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:45.415224 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f9c21028-a653-469a-abb9-1ce41dd24be8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:45.428122 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f9c21028-a653-469a-abb9-1ce41dd24be8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1557 microversion: 2.1 time: 0.218177 May 13 17:30:45.428963 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 347/701] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:45 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1557 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:45.436143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-96d09771-4451-4397-b939-f55d68b45d3e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:45.440084 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-96d09771-4451-4397-b939-f55d68b45d3e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:45.451649 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-96d09771-4451-4397-b939-f55d68b45d3e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:45.452101 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-96d09771-4451-4397-b939-f55d68b45d3e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:45.453082 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-96d09771-4451-4397-b939-f55d68b45d3e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:45.453693 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-96d09771-4451-4397-b939-f55d68b45d3e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:45.490229 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-60acf579-2480-497e-b820-eff57bdd7cd9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:45.495369 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-60acf579-2480-497e-b820-eff57bdd7cd9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1508 microversion: 2.1 time: 0.198676 May 13 17:30:45.505021 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 355/702] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:45 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1508 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:45.505021 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e589d742-40b7-4cf4-a8ff-62e41e48fafc tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:45.505021 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e589d742-40b7-4cf4-a8ff-62e41e48fafc tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:45.511232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e589d742-40b7-4cf4-a8ff-62e41e48fafc tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:45.511648 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e589d742-40b7-4cf4-a8ff-62e41e48fafc tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:45.512431 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e589d742-40b7-4cf4-a8ff-62e41e48fafc tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:45.512871 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e589d742-40b7-4cf4-a8ff-62e41e48fafc tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:45.632699 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e589d742-40b7-4cf4-a8ff-62e41e48fafc tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.134576 May 13 17:30:45.636911 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-96d09771-4451-4397-b939-f55d68b45d3e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:45.639971 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 356/703] 10.222.0.64 () {58 vars in 1274 bytes} [Fri May 13 17:30:45 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:30:45.645452 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-96d09771-4451-4397-b939-f55d68b45d3e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:45.652454 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-96d09771-4451-4397-b939-f55d68b45d3e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:45.653665 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-96d09771-4451-4397-b939-f55d68b45d3e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.223602 May 13 17:30:45.654569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 348/704] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:45 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:30:45.897414 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-24b4d367-313d-4443-87bc-9d819a59b08d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:45.901907 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-24b4d367-313d-4443-87bc-9d819a59b08d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:45.918246 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-24b4d367-313d-4443-87bc-9d819a59b08d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:45.919081 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-24b4d367-313d-4443-87bc-9d819a59b08d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:45.921033 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-24b4d367-313d-4443-87bc-9d819a59b08d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:45.922654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-24b4d367-313d-4443-87bc-9d819a59b08d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:46.171293 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-24b4d367-313d-4443-87bc-9d819a59b08d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:46.178920 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-24b4d367-313d-4443-87bc-9d819a59b08d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.291892 May 13 17:30:46.195137 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 357/705] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:45 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:46.513537 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-fd7e6dc9-2852-4012-ae1c-23b3725c559a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:46.514172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-fd7e6dc9-2852-4012-ae1c-23b3725c559a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:46.521148 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fd7e6dc9-2852-4012-ae1c-23b3725c559a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:46.521607 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fd7e6dc9-2852-4012-ae1c-23b3725c559a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:46.522411 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fd7e6dc9-2852-4012-ae1c-23b3725c559a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:46.529695 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fd7e6dc9-2852-4012-ae1c-23b3725c559a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:46.670812 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-fd7e6dc9-2852-4012-ae1c-23b3725c559a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:46.672001 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-27500cd7-d8c8-4271-a072-3f8b140a4d30 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:46.672619 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-27500cd7-d8c8-4271-a072-3f8b140a4d30 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:46.678536 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-27500cd7-d8c8-4271-a072-3f8b140a4d30 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:46.679364 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-27500cd7-d8c8-4271-a072-3f8b140a4d30 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:46.680341 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-27500cd7-d8c8-4271-a072-3f8b140a4d30 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:46.680974 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-27500cd7-d8c8-4271-a072-3f8b140a4d30 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:46.683393 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-fd7e6dc9-2852-4012-ae1c-23b3725c559a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1508 microversion: 2.1 time: 0.172124 May 13 17:30:46.693121 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 349/706] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:46 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1508 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:46.934110 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-27500cd7-d8c8-4271-a072-3f8b140a4d30 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:46.944076 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-27500cd7-d8c8-4271-a072-3f8b140a4d30 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:46.946941 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-27500cd7-d8c8-4271-a072-3f8b140a4d30 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:46.952517 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-27500cd7-d8c8-4271-a072-3f8b140a4d30 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.282806 May 13 17:30:46.965332 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 358/707] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:46 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:30:47.022675 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-0380f0ed-d5a8-4a30-9b40-d3d44fcd1a3b req-1197cc3b-7e40-416a-b823-69a8b34155a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2", "tag": "59800603-642e-4f31-b41b-ffa2355488f5"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:30:47.030884 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-0380f0ed-d5a8-4a30-9b40-d3d44fcd1a3b req-1197cc3b-7e40-416a-b823-69a8b34155a4 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:47.031555 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-0380f0ed-d5a8-4a30-9b40-d3d44fcd1a3b req-1197cc3b-7e40-416a-b823-69a8b34155a4 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:47.043495 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-0380f0ed-d5a8-4a30-9b40-d3d44fcd1a3b req-1197cc3b-7e40-416a-b823-69a8b34155a4 service nova] Creating event network-changed:59800603-642e-4f31-b41b-ffa2355488f5 for instance 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 on hv-cinder-84178 May 13 17:30:47.048993 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-0380f0ed-d5a8-4a30-9b40-d3d44fcd1a3b req-1197cc3b-7e40-416a-b823-69a8b34155a4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029932 May 13 17:30:47.054953 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 350/708] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:30:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:30:47.197399 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-656ecb01-572a-4fa6-95da-b8babbc6d96d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:47.198401 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-656ecb01-572a-4fa6-95da-b8babbc6d96d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:47.206964 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-656ecb01-572a-4fa6-95da-b8babbc6d96d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:47.207498 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-656ecb01-572a-4fa6-95da-b8babbc6d96d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:47.208291 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-656ecb01-572a-4fa6-95da-b8babbc6d96d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:47.208732 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-656ecb01-572a-4fa6-95da-b8babbc6d96d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:47.365908 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-656ecb01-572a-4fa6-95da-b8babbc6d96d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:47.374778 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-656ecb01-572a-4fa6-95da-b8babbc6d96d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.181840 May 13 17:30:47.383918 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 359/709] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:47 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:47.701709 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6bd651f4-42dd-4b2f-8dca-b7019fde27b1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:47.703114 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6bd651f4-42dd-4b2f-8dca-b7019fde27b1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:47.710839 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6bd651f4-42dd-4b2f-8dca-b7019fde27b1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:47.711681 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6bd651f4-42dd-4b2f-8dca-b7019fde27b1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:47.712695 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6bd651f4-42dd-4b2f-8dca-b7019fde27b1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:47.713194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6bd651f4-42dd-4b2f-8dca-b7019fde27b1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:47.868489 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6bd651f4-42dd-4b2f-8dca-b7019fde27b1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:47.878220 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6bd651f4-42dd-4b2f-8dca-b7019fde27b1 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1508 microversion: 2.1 time: 0.180787 May 13 17:30:47.888987 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 351/710] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:47 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1508 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:47.972508 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2e87d71e-28c5-47d8-8c8e-a86f356b50a5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:47.973281 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2e87d71e-28c5-47d8-8c8e-a86f356b50a5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:47.980969 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2e87d71e-28c5-47d8-8c8e-a86f356b50a5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:47.981414 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2e87d71e-28c5-47d8-8c8e-a86f356b50a5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:47.982223 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2e87d71e-28c5-47d8-8c8e-a86f356b50a5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:47.983104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2e87d71e-28c5-47d8-8c8e-a86f356b50a5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:48.190153 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2e87d71e-28c5-47d8-8c8e-a86f356b50a5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:48.203481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2e87d71e-28c5-47d8-8c8e-a86f356b50a5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:48.205382 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2e87d71e-28c5-47d8-8c8e-a86f356b50a5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:48.206966 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2e87d71e-28c5-47d8-8c8e-a86f356b50a5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.238502 May 13 17:30:48.208170 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 360/711] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:47 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:30:48.394402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-39f31dc5-a8c0-45aa-8521-62e413db65c6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:48.395066 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-39f31dc5-a8c0-45aa-8521-62e413db65c6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:48.406674 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-39f31dc5-a8c0-45aa-8521-62e413db65c6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:48.407532 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-39f31dc5-a8c0-45aa-8521-62e413db65c6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:48.408779 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-39f31dc5-a8c0-45aa-8521-62e413db65c6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:48.409528 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-39f31dc5-a8c0-45aa-8521-62e413db65c6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:48.619577 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-39f31dc5-a8c0-45aa-8521-62e413db65c6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:48.631885 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-39f31dc5-a8c0-45aa-8521-62e413db65c6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.243582 May 13 17:30:48.644979 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 352/712] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:48 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:48.902953 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d0a645b2-cbfe-47d6-a786-2b3836d5b9e3 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:48.904134 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d0a645b2-cbfe-47d6-a786-2b3836d5b9e3 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:48.911453 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d0a645b2-cbfe-47d6-a786-2b3836d5b9e3 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:48.911904 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d0a645b2-cbfe-47d6-a786-2b3836d5b9e3 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:48.912967 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d0a645b2-cbfe-47d6-a786-2b3836d5b9e3 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:48.920764 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d0a645b2-cbfe-47d6-a786-2b3836d5b9e3 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:49.085361 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d0a645b2-cbfe-47d6-a786-2b3836d5b9e3 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:49.094797 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d0a645b2-cbfe-47d6-a786-2b3836d5b9e3 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1508 microversion: 2.1 time: 0.195743 May 13 17:30:49.095603 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 361/713] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:48 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1508 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:49.226331 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-8c85489c-5650-4ceb-9899-86fb8e26db76 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:49.226938 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-8c85489c-5650-4ceb-9899-86fb8e26db76 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:49.233824 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8c85489c-5650-4ceb-9899-86fb8e26db76 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:49.234276 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8c85489c-5650-4ceb-9899-86fb8e26db76 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:49.235045 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8c85489c-5650-4ceb-9899-86fb8e26db76 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:49.235681 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8c85489c-5650-4ceb-9899-86fb8e26db76 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:49.394497 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-8c85489c-5650-4ceb-9899-86fb8e26db76 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:49.410406 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-8c85489c-5650-4ceb-9899-86fb8e26db76 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:49.416491 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-8c85489c-5650-4ceb-9899-86fb8e26db76 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:49.417724 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-8c85489c-5650-4ceb-9899-86fb8e26db76 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.195318 May 13 17:30:49.418956 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 353/714] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:49 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:30:49.649852 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f79f97f1-001e-4492-bb80-c131a617ecc9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:49.650468 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f79f97f1-001e-4492-bb80-c131a617ecc9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:49.656185 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f79f97f1-001e-4492-bb80-c131a617ecc9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:49.656642 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f79f97f1-001e-4492-bb80-c131a617ecc9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:49.657415 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f79f97f1-001e-4492-bb80-c131a617ecc9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:49.657856 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f79f97f1-001e-4492-bb80-c131a617ecc9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:49.790824 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f79f97f1-001e-4492-bb80-c131a617ecc9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:49.802826 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f79f97f1-001e-4492-bb80-c131a617ecc9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.156832 May 13 17:30:49.803442 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 362/715] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:49 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:50.112344 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-5c2033f6-5f48-461d-a29b-905115b951fa tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:50.113624 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-5c2033f6-5f48-461d-a29b-905115b951fa tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:50.120761 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5c2033f6-5f48-461d-a29b-905115b951fa tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:50.121518 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5c2033f6-5f48-461d-a29b-905115b951fa tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:50.122359 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5c2033f6-5f48-461d-a29b-905115b951fa tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:50.122887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5c2033f6-5f48-461d-a29b-905115b951fa tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:50.282171 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-5c2033f6-5f48-461d-a29b-905115b951fa tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:50.290467 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-5c2033f6-5f48-461d-a29b-905115b951fa tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1514 microversion: 2.1 time: 0.181971 May 13 17:30:50.291281 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 354/716] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:50 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:50.436210 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-78a37eaa-5d2e-4244-b15e-1959d605535b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:50.437468 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-78a37eaa-5d2e-4244-b15e-1959d605535b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:50.445793 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-78a37eaa-5d2e-4244-b15e-1959d605535b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:50.446376 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-78a37eaa-5d2e-4244-b15e-1959d605535b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:50.447098 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-78a37eaa-5d2e-4244-b15e-1959d605535b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:50.449084 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-78a37eaa-5d2e-4244-b15e-1959d605535b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:50.599940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-78a37eaa-5d2e-4244-b15e-1959d605535b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:50.608843 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-78a37eaa-5d2e-4244-b15e-1959d605535b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:50.611331 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-78a37eaa-5d2e-4244-b15e-1959d605535b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:50.613040 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-78a37eaa-5d2e-4244-b15e-1959d605535b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.181748 May 13 17:30:50.613917 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 363/717] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:50 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:30:50.822702 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6dd1e7d5-f17e-4e6b-89ad-c2c0f849eb7d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:50.823587 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6dd1e7d5-f17e-4e6b-89ad-c2c0f849eb7d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:50.837510 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6dd1e7d5-f17e-4e6b-89ad-c2c0f849eb7d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:50.838244 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6dd1e7d5-f17e-4e6b-89ad-c2c0f849eb7d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:50.839609 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6dd1e7d5-f17e-4e6b-89ad-c2c0f849eb7d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:50.840933 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6dd1e7d5-f17e-4e6b-89ad-c2c0f849eb7d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:51.009268 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6dd1e7d5-f17e-4e6b-89ad-c2c0f849eb7d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:51.018899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6dd1e7d5-f17e-4e6b-89ad-c2c0f849eb7d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.201017 May 13 17:30:51.020067 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 355/718] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:50 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:51.633846 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-864b03f6-1434-4604-8d95-28450f5f0b3c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:51.635586 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-864b03f6-1434-4604-8d95-28450f5f0b3c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:51.643599 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-864b03f6-1434-4604-8d95-28450f5f0b3c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:51.644146 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-864b03f6-1434-4604-8d95-28450f5f0b3c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:51.645634 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-864b03f6-1434-4604-8d95-28450f5f0b3c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:51.646536 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-864b03f6-1434-4604-8d95-28450f5f0b3c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:51.853368 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-864b03f6-1434-4604-8d95-28450f5f0b3c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:51.862151 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-864b03f6-1434-4604-8d95-28450f5f0b3c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:51.864304 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-864b03f6-1434-4604-8d95-28450f5f0b3c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:51.865763 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-864b03f6-1434-4604-8d95-28450f5f0b3c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.238044 May 13 17:30:51.866702 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 364/719] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:51 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:30:52.036187 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-8bd0f43d-9945-4411-928e-4b9676f992fd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:52.037389 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-8bd0f43d-9945-4411-928e-4b9676f992fd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:52.044230 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8bd0f43d-9945-4411-928e-4b9676f992fd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:52.045024 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8bd0f43d-9945-4411-928e-4b9676f992fd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:52.046107 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8bd0f43d-9945-4411-928e-4b9676f992fd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:52.046701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8bd0f43d-9945-4411-928e-4b9676f992fd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:52.198795 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-8bd0f43d-9945-4411-928e-4b9676f992fd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:52.207324 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-8bd0f43d-9945-4411-928e-4b9676f992fd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.174931 May 13 17:30:52.217890 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 356/720] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:52 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:52.889547 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-634646d5-168d-4923-84de-475f0f38effa tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:52.890323 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-634646d5-168d-4923-84de-475f0f38effa tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:52.897053 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-634646d5-168d-4923-84de-475f0f38effa tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:52.897517 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-634646d5-168d-4923-84de-475f0f38effa tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:52.898374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-634646d5-168d-4923-84de-475f0f38effa tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:52.898827 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-634646d5-168d-4923-84de-475f0f38effa tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:53.000056 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-e233cbef-2d84-436d-8232-d74efb0ced09 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Action: 'create', calling method: .version_select at 0x7fa084b18700>, body: {"keypair": {"name": "tempest-keypair-1476670057", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDQcqp784mc3dwXlzGKU42/G0ar8b/Ceto4e18DTNp9B8YBoSfV5F9Ys5ueAEgQhKppi2C/hblavo+zIXnKsKa+vE/q1yWkaznQuEtDD8b570uYZvDitnv+dBQWl70nC7g=="}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:30:53.017764 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-e233cbef-2d84-436d-8232-d74efb0ced09 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Getting quotas for project 27832590c00f47b7b09c343e892f310a. Resources: {'key_pairs'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:30:53.021671 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-e233cbef-2d84-436d-8232-d74efb0ced09 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Getting quotas for user a0294c57ba3f41bc8cf2cac294bb678c and project 27832590c00f47b7b09c343e892f310a. Resources: {'key_pairs'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:30:53.053665 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-634646d5-168d-4923-84de-475f0f38effa tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:53.061498 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-634646d5-168d-4923-84de-475f0f38effa tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:53.063056 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-634646d5-168d-4923-84de-475f0f38effa tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:53.064262 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-634646d5-168d-4923-84de-475f0f38effa tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1744 microversion: 2.20 time: 0.179253 May 13 17:30:53.064806 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 365/721] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:52 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1744 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:30:53.129386 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-e233cbef-2d84-436d-8232-d74efb0ced09 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.133050 May 13 17:30:53.131092 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 357/722] 10.222.0.64 () {60 vars in 1158 bytes} [Fri May 13 17:30:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:30:53.226358 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5deefbdf-c418-4c0e-8e56-64ade2f4ae1c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:53.228570 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5deefbdf-c418-4c0e-8e56-64ade2f4ae1c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:53.234895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5deefbdf-c418-4c0e-8e56-64ade2f4ae1c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:53.235513 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5deefbdf-c418-4c0e-8e56-64ade2f4ae1c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:53.236555 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5deefbdf-c418-4c0e-8e56-64ade2f4ae1c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:53.237669 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5deefbdf-c418-4c0e-8e56-64ade2f4ae1c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:53.407036 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5deefbdf-c418-4c0e-8e56-64ade2f4ae1c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:53.414671 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5deefbdf-c418-4c0e-8e56-64ade2f4ae1c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.193606 May 13 17:30:53.415258 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 366/723] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:53 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:54.082972 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-53d83737-c43d-4e30-b2ec-150104160312 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:54.083650 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-53d83737-c43d-4e30-b2ec-150104160312 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:54.092065 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-53d83737-c43d-4e30-b2ec-150104160312 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:54.093519 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-53d83737-c43d-4e30-b2ec-150104160312 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:54.095785 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-53d83737-c43d-4e30-b2ec-150104160312 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:54.096885 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-53d83737-c43d-4e30-b2ec-150104160312 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:54.344427 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-53d83737-c43d-4e30-b2ec-150104160312 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:54.360554 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-53d83737-c43d-4e30-b2ec-150104160312 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:54.362302 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-53d83737-c43d-4e30-b2ec-150104160312 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:54.370598 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-53d83737-c43d-4e30-b2ec-150104160312 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1744 microversion: 2.20 time: 0.290006 May 13 17:30:54.376040 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 358/724] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:54 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1744 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:30:54.434980 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-513e09f0-f4d3-4afd-a793-c610ed00231c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:54.435888 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-513e09f0-f4d3-4afd-a793-c610ed00231c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:54.443450 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-513e09f0-f4d3-4afd-a793-c610ed00231c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:54.444080 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-513e09f0-f4d3-4afd-a793-c610ed00231c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:54.444877 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-513e09f0-f4d3-4afd-a793-c610ed00231c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:54.445320 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-513e09f0-f4d3-4afd-a793-c610ed00231c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:54.708703 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-513e09f0-f4d3-4afd-a793-c610ed00231c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:54.723791 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-513e09f0-f4d3-4afd-a793-c610ed00231c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.292749 May 13 17:30:54.726441 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 367/725] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:54 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:30:55.030437 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a72a55ba-e784-4578-bab2-a813e18d2355 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "44a5c87b-ffcf-4de6-b87d-a9e4d0fa6fd9", "device": "/dev/sdb"}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:30:55.032747 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a72a55ba-e784-4578-bab2-a813e18d2355 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:55.045636 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a72a55ba-e784-4578-bab2-a813e18d2355 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:55.046383 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a72a55ba-e784-4578-bab2-a813e18d2355 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:55.047394 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a72a55ba-e784-4578-bab2-a813e18d2355 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:55.048025 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a72a55ba-e784-4578-bab2-a813e18d2355 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:55.390005 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9d51c435-db58-428e-b00e-7393e0d26531 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:55.390619 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9d51c435-db58-428e-b00e-7393e0d26531 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:55.404762 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9d51c435-db58-428e-b00e-7393e0d26531 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:55.405371 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9d51c435-db58-428e-b00e-7393e0d26531 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:55.407745 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9d51c435-db58-428e-b00e-7393e0d26531 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:55.407889 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9d51c435-db58-428e-b00e-7393e0d26531 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:55.674272 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9d51c435-db58-428e-b00e-7393e0d26531 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:55.692356 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9d51c435-db58-428e-b00e-7393e0d26531 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:55.700809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9d51c435-db58-428e-b00e-7393e0d26531 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:55.710393 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9d51c435-db58-428e-b00e-7393e0d26531 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1744 microversion: 2.20 time: 0.321753 May 13 17:30:55.715015 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 368/726] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:55 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1744 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:30:55.743613 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-cd0d2372-8414-4244-aeaf-de7df1c46e2c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:55.744528 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-cd0d2372-8414-4244-aeaf-de7df1c46e2c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:55.755737 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cd0d2372-8414-4244-aeaf-de7df1c46e2c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:55.758154 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cd0d2372-8414-4244-aeaf-de7df1c46e2c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:55.759949 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cd0d2372-8414-4244-aeaf-de7df1c46e2c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:55.760765 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cd0d2372-8414-4244-aeaf-de7df1c46e2c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:55.962706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-cd0d2372-8414-4244-aeaf-de7df1c46e2c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:55.973100 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-cd0d2372-8414-4244-aeaf-de7df1c46e2c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1258 microversion: 2.1 time: 0.234702 May 13 17:30:55.974296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 369/727] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:55 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1258 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:55.980848 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-74494f19-a441-4b60-b44f-3a693bcba44f req-047ba1e5-277b-4314-aa9f-947df514ca02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65fdbf1a-f080-4d79-b3f3-c465e5a81c67", "name": "network-vif-plugged", "status": "completed", "tag": "41053781-3367-4859-b7f7-eb83af021a82"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:30:56.015943 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-74494f19-a441-4b60-b44f-3a693bcba44f req-047ba1e5-277b-4314-aa9f-947df514ca02 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:56.019190 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-74494f19-a441-4b60-b44f-3a693bcba44f req-047ba1e5-277b-4314-aa9f-947df514ca02 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:56.043878 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-74494f19-a441-4b60-b44f-3a693bcba44f req-047ba1e5-277b-4314-aa9f-947df514ca02 service nova] Creating event network-vif-plugged:41053781-3367-4859-b7f7-eb83af021a82 for instance 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 on hv-cinder-84178 May 13 17:30:56.053489 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-74494f19-a441-4b60-b44f-3a693bcba44f req-047ba1e5-277b-4314-aa9f-947df514ca02 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074607 May 13 17:30:56.053489 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 370/728] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:30:56.279570 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-68a520d4-15ec-43b5-a8b4-a75780d20dbb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1178216893", "imageRef": "7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0ae3692e-0df2-47ad-8286-157d76fd0bbd"}], "security_groups": [{"name": "tempest-securitygroup--2120436085"}], "key_name": "tempest-keypair-1476670057", "user_data": "}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:30:56.388472 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.network.neutron [None req-68a520d4-15ec-43b5-a8b4-a75780d20dbb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] validate_networks() for [('0ae3692e-0df2-47ad-8286-157d76fd0bbd', None, None, None, None, None)] {{(pid=117493) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 17:30:56.862594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-68a520d4-15ec-43b5-a8b4-a75780d20dbb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Flavor limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 17:30:56.863280 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-68a520d4-15ec-43b5-a8b4-a75780d20dbb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Image limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 17:30:56.863966 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-68a520d4-15ec-43b5-a8b4-a75780d20dbb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Flavor pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 17:30:56.864443 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-68a520d4-15ec-43b5-a8b4-a75780d20dbb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Image pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 17:30:56.864910 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-68a520d4-15ec-43b5-a8b4-a75780d20dbb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 17:30:56.878980 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-68a520d4-15ec-43b5-a8b4-a75780d20dbb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:56.879674 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-68a520d4-15ec-43b5-a8b4-a75780d20dbb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:56.880725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-68a520d4-15ec-43b5-a8b4-a75780d20dbb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:56.881167 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-68a520d4-15ec-43b5-a8b4-a75780d20dbb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:56.900389 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-68a520d4-15ec-43b5-a8b4-a75780d20dbb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Getting quotas for project 27832590c00f47b7b09c343e892f310a. Resources: {'ram', 'instances', 'cores'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:30:56.904771 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-68a520d4-15ec-43b5-a8b4-a75780d20dbb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Getting quotas for user a0294c57ba3f41bc8cf2cac294bb678c and project 27832590c00f47b7b09c343e892f310a. Resources: {'ram', 'instances', 'cores'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:30:56.916764 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-68a520d4-15ec-43b5-a8b4-a75780d20dbb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Going to run 1 instances... {{(pid=117493) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 17:30:56.924344 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-68a520d4-15ec-43b5-a8b4-a75780d20dbb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 17:30:57.039482 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-68a520d4-15ec-43b5-a8b4-a75780d20dbb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.764804 May 13 17:30:57.046580 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 371/729] 10.222.0.64 () {60 vars in 1146 bytes} [Fri May 13 17:30:56 2022] POST /compute/v2.1/servers => generated 409 bytes in 773 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 17:30:57.053529 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-212d6f02-2354-4954-a530-838cc17a7890 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:57.054995 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-212d6f02-2354-4954-a530-838cc17a7890 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:57.079715 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-212d6f02-2354-4954-a530-838cc17a7890 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:57.080183 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-212d6f02-2354-4954-a530-838cc17a7890 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:57.081068 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-212d6f02-2354-4954-a530-838cc17a7890 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:57.081446 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-212d6f02-2354-4954-a530-838cc17a7890 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:57.404893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-212d6f02-2354-4954-a530-838cc17a7890 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:57.415654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-212d6f02-2354-4954-a530-838cc17a7890 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:57.417665 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-212d6f02-2354-4954-a530-838cc17a7890 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:57.419532 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-212d6f02-2354-4954-a530-838cc17a7890 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1744 microversion: 2.20 time: 0.371627 May 13 17:30:57.420322 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 372/730] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:57 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1744 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:30:57.435787 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-effa0452-cb93-4260-9d04-3d2320e07c72 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:57.436227 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-effa0452-cb93-4260-9d04-3d2320e07c72 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:57.443065 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-effa0452-cb93-4260-9d04-3d2320e07c72 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:57.443557 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-effa0452-cb93-4260-9d04-3d2320e07c72 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:57.444423 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-effa0452-cb93-4260-9d04-3d2320e07c72 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:57.444820 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-effa0452-cb93-4260-9d04-3d2320e07c72 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:57.689918 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-effa0452-cb93-4260-9d04-3d2320e07c72 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:57.698223 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-effa0452-cb93-4260-9d04-3d2320e07c72 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1442 microversion: 2.1 time: 0.276705 May 13 17:30:57.698779 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 373/731] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:57 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1442 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:57.714487 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-89c526e3-459a-4b1a-a501-8afc64d48e78 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:57.715057 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-89c526e3-459a-4b1a-a501-8afc64d48e78 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:57.768383 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a72a55ba-e784-4578-bab2-a813e18d2355 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "POST /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.745293 May 13 17:30:57.769310 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 359/732] 10.222.0.64 () {60 vars in 1322 bytes} [Fri May 13 17:30:55 2022] POST /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1/os-volume_attachments => generated 194 bytes in 2748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:30:57.783707 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-86e84683-947c-4d36-b2c4-3b43bf9af3a9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:30:57.793486 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-89c526e3-459a-4b1a-a501-8afc64d48e78 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:57.801044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-89c526e3-459a-4b1a-a501-8afc64d48e78 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1246 microversion: 2.1 time: 0.101201 May 13 17:30:57.807838 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 374/733] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:57 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1246 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:57.816264 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fb73dbc4-5644-4641-a6da-c0413139dea5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:57.821583 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-86e84683-947c-4d36-b2c4-3b43bf9af3a9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:57.828270 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-86e84683-947c-4d36-b2c4-3b43bf9af3a9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:57.828705 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fb73dbc4-5644-4641-a6da-c0413139dea5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:57.838907 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fb73dbc4-5644-4641-a6da-c0413139dea5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:57.839847 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fb73dbc4-5644-4641-a6da-c0413139dea5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:57.841353 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fb73dbc4-5644-4641-a6da-c0413139dea5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:57.841793 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fb73dbc4-5644-4641-a6da-c0413139dea5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:57.915877 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-86e84683-947c-4d36-b2c4-3b43bf9af3a9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Going to try to stop instance {{(pid=117492) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 13 17:30:58.024002 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fb73dbc4-5644-4641-a6da-c0413139dea5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:58.040996 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fb73dbc4-5644-4641-a6da-c0413139dea5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1442 microversion: 2.1 time: 0.231651 May 13 17:30:58.053519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 375/734] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:57 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1442 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:58.159012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-86e84683-947c-4d36-b2c4-3b43bf9af3a9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "POST /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48/action" status: 202 len: 0 microversion: 2.1 time: 0.382272 May 13 17:30:58.160103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 360/735] 10.222.0.64 () {60 vars in 1277 bytes} [Fri May 13 17:30:57 2022] POST /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:30:58.169295 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-25c015a1-e137-49a6-aea0-02d497a58351 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:58.170076 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-25c015a1-e137-49a6-aea0-02d497a58351 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:58.192683 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-25c015a1-e137-49a6-aea0-02d497a58351 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:58.192683 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-25c015a1-e137-49a6-aea0-02d497a58351 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:58.197444 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-25c015a1-e137-49a6-aea0-02d497a58351 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:58.197917 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-25c015a1-e137-49a6-aea0-02d497a58351 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:58.389387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-25c015a1-e137-49a6-aea0-02d497a58351 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:58.401181 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-25c015a1-e137-49a6-aea0-02d497a58351 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1724 microversion: 2.1 time: 0.236590 May 13 17:30:58.402150 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 376/736] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:58 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1724 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:58.445852 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-dc7c8e05-c5c3-4bfd-8ab1-d3ba8b1ce9a2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:58.446749 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-dc7c8e05-c5c3-4bfd-8ab1-d3ba8b1ce9a2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:58.456824 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dc7c8e05-c5c3-4bfd-8ab1-d3ba8b1ce9a2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:58.457996 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dc7c8e05-c5c3-4bfd-8ab1-d3ba8b1ce9a2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:58.459001 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dc7c8e05-c5c3-4bfd-8ab1-d3ba8b1ce9a2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:58.459662 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dc7c8e05-c5c3-4bfd-8ab1-d3ba8b1ce9a2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:58.820326 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8271ed5b-0e09-47cd-b170-6e0f7360e4fa tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:58.820797 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8271ed5b-0e09-47cd-b170-6e0f7360e4fa tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:58.832481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8271ed5b-0e09-47cd-b170-6e0f7360e4fa tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:58.833234 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8271ed5b-0e09-47cd-b170-6e0f7360e4fa tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:58.834189 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8271ed5b-0e09-47cd-b170-6e0f7360e4fa tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:58.839873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8271ed5b-0e09-47cd-b170-6e0f7360e4fa tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:58.939222 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8271ed5b-0e09-47cd-b170-6e0f7360e4fa tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:58.946971 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8271ed5b-0e09-47cd-b170-6e0f7360e4fa tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1242 microversion: 2.1 time: 0.130556 May 13 17:30:58.958552 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 377/737] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:58 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1242 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:59.026118 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-dc7c8e05-c5c3-4bfd-8ab1-d3ba8b1ce9a2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:59.036303 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-dc7c8e05-c5c3-4bfd-8ab1-d3ba8b1ce9a2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:59.038841 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-dc7c8e05-c5c3-4bfd-8ab1-d3ba8b1ce9a2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:59.040540 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-dc7c8e05-c5c3-4bfd-8ab1-d3ba8b1ce9a2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1744 microversion: 2.20 time: 0.605167 May 13 17:30:59.042506 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 361/738] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:30:58 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1744 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:30:59.420803 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-48fb113b-1d90-4524-b086-67af55b9bf63 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:59.421429 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-48fb113b-1d90-4524-b086-67af55b9bf63 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:30:59.429912 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-48fb113b-1d90-4524-b086-67af55b9bf63 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:59.431531 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-48fb113b-1d90-4524-b086-67af55b9bf63 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:59.432343 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-48fb113b-1d90-4524-b086-67af55b9bf63 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:30:59.432791 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-48fb113b-1d90-4524-b086-67af55b9bf63 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:30:59.580306 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-48fb113b-1d90-4524-b086-67af55b9bf63 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:30:59.589452 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-48fb113b-1d90-4524-b086-67af55b9bf63 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1724 microversion: 2.1 time: 0.172310 May 13 17:30:59.590258 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 378/739] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:59 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:30:59.973443 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-38dc64b3-b397-484b-a14f-c36421ac0a85 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:30:59.985265 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-38dc64b3-b397-484b-a14f-c36421ac0a85 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:00.014710 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-38dc64b3-b397-484b-a14f-c36421ac0a85 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:00.015202 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-38dc64b3-b397-484b-a14f-c36421ac0a85 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:00.015998 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-38dc64b3-b397-484b-a14f-c36421ac0a85 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:00.016433 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-38dc64b3-b397-484b-a14f-c36421ac0a85 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:00.062064 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-72756c87-0aac-49dc-86a8-a060b63bd57e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:00.062701 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-72756c87-0aac-49dc-86a8-a060b63bd57e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:00.072793 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-72756c87-0aac-49dc-86a8-a060b63bd57e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:00.075821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-72756c87-0aac-49dc-86a8-a060b63bd57e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:00.076910 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-72756c87-0aac-49dc-86a8-a060b63bd57e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:00.078956 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-72756c87-0aac-49dc-86a8-a060b63bd57e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:00.247758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-38dc64b3-b397-484b-a14f-c36421ac0a85 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:00.256403 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-38dc64b3-b397-484b-a14f-c36421ac0a85 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1306 microversion: 2.1 time: 0.293990 May 13 17:31:00.257603 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 362/740] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:30:59 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1306 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:00.364257 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-72756c87-0aac-49dc-86a8-a060b63bd57e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:00.398022 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-72756c87-0aac-49dc-86a8-a060b63bd57e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:00.408081 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-72756c87-0aac-49dc-86a8-a060b63bd57e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:00.408081 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-72756c87-0aac-49dc-86a8-a060b63bd57e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1744 microversion: 2.20 time: 0.349472 May 13 17:31:00.408081 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 379/741] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:00 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1744 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:31:00.607440 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-8e00fe66-0ca5-49ea-a02d-d5cf0166dd3f tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:00.608343 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-8e00fe66-0ca5-49ea-a02d-d5cf0166dd3f tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:00.614604 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8e00fe66-0ca5-49ea-a02d-d5cf0166dd3f tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:00.615056 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8e00fe66-0ca5-49ea-a02d-d5cf0166dd3f tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:00.615951 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8e00fe66-0ca5-49ea-a02d-d5cf0166dd3f tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:00.616916 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8e00fe66-0ca5-49ea-a02d-d5cf0166dd3f tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:00.866797 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-8e00fe66-0ca5-49ea-a02d-d5cf0166dd3f tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:00.878675 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-8e00fe66-0ca5-49ea-a02d-d5cf0166dd3f tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1724 microversion: 2.1 time: 0.273291 May 13 17:31:00.879619 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 363/742] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:00 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:01.234988 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-9b706a04-f3e2-454e-9bf4-dd68472e984e req-b5d4e171-b4a4-40c8-9048-edf89a76e33d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a310844-e208-4f17-a8c9-fd4db4acf00d", "tag": "f37d13dd-347a-41e2-8ca5-2b0f1df46c9c"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:31:01.246200 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-9b706a04-f3e2-454e-9bf4-dd68472e984e req-b5d4e171-b4a4-40c8-9048-edf89a76e33d service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:01.246897 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-9b706a04-f3e2-454e-9bf4-dd68472e984e req-b5d4e171-b4a4-40c8-9048-edf89a76e33d service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:01.262135 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-9b706a04-f3e2-454e-9bf4-dd68472e984e req-b5d4e171-b4a4-40c8-9048-edf89a76e33d service nova] Creating event network-changed:f37d13dd-347a-41e2-8ca5-2b0f1df46c9c for instance 7a310844-e208-4f17-a8c9-fd4db4acf00d on hv-cinder-84178 May 13 17:31:01.270416 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-9b706a04-f3e2-454e-9bf4-dd68472e984e req-b5d4e171-b4a4-40c8-9048-edf89a76e33d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040006 May 13 17:31:01.271765 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 380/743] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:31:01.274698 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-64fd500c-ad9d-476d-87be-9a3d428fecf2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:01.275239 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-64fd500c-ad9d-476d-87be-9a3d428fecf2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:01.289650 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-64fd500c-ad9d-476d-87be-9a3d428fecf2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:01.290108 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-64fd500c-ad9d-476d-87be-9a3d428fecf2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:01.297539 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-64fd500c-ad9d-476d-87be-9a3d428fecf2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:01.297943 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-64fd500c-ad9d-476d-87be-9a3d428fecf2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:01.430381 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-16631b0d-57a1-402f-afcf-effc0f65f015 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:01.436453 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-16631b0d-57a1-402f-afcf-effc0f65f015 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:01.455313 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-16631b0d-57a1-402f-afcf-effc0f65f015 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:01.455773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-16631b0d-57a1-402f-afcf-effc0f65f015 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:01.456566 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-16631b0d-57a1-402f-afcf-effc0f65f015 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:01.456993 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-16631b0d-57a1-402f-afcf-effc0f65f015 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:01.720870 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-64fd500c-ad9d-476d-87be-9a3d428fecf2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:01.728821 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-64fd500c-ad9d-476d-87be-9a3d428fecf2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1372 microversion: 2.1 time: 0.458840 May 13 17:31:01.755108 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 364/744] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:01 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1372 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:31:01.902950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f8a3ccaa-f073-46a3-b840-dbd591685459 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:01.904370 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-f8a3ccaa-f073-46a3-b840-dbd591685459 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:01.912717 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f8a3ccaa-f073-46a3-b840-dbd591685459 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:01.914695 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f8a3ccaa-f073-46a3-b840-dbd591685459 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:01.915791 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f8a3ccaa-f073-46a3-b840-dbd591685459 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:01.917095 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f8a3ccaa-f073-46a3-b840-dbd591685459 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:01.930519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-16631b0d-57a1-402f-afcf-effc0f65f015 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:01.938645 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-16631b0d-57a1-402f-afcf-effc0f65f015 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:01.940447 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-16631b0d-57a1-402f-afcf-effc0f65f015 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:01.941832 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-16631b0d-57a1-402f-afcf-effc0f65f015 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1744 microversion: 2.20 time: 0.520820 May 13 17:31:01.943350 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 381/745] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:01 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1744 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:31:02.088618 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f8a3ccaa-f073-46a3-b840-dbd591685459 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:02.097178 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f8a3ccaa-f073-46a3-b840-dbd591685459 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1724 microversion: 2.1 time: 0.203858 May 13 17:31:02.097748 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 365/746] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:01 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:31:02.746843 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6211f92c-e97f-4a4b-be40-875431f005be tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:02.747501 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6211f92c-e97f-4a4b-be40-875431f005be tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:02.759406 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6211f92c-e97f-4a4b-be40-875431f005be tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:02.759865 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6211f92c-e97f-4a4b-be40-875431f005be tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:02.760664 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6211f92c-e97f-4a4b-be40-875431f005be tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:02.761371 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6211f92c-e97f-4a4b-be40-875431f005be tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:02.965021 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-91ea08be-72cf-47a5-8fa5-dc4a311bbad9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:02.965722 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-91ea08be-72cf-47a5-8fa5-dc4a311bbad9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:02.980938 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6211f92c-e97f-4a4b-be40-875431f005be tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:02.981138 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-91ea08be-72cf-47a5-8fa5-dc4a311bbad9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:02.981138 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-91ea08be-72cf-47a5-8fa5-dc4a311bbad9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:02.984430 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6211f92c-e97f-4a4b-be40-875431f005be tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1372 microversion: 2.1 time: 0.241326 May 13 17:31:02.985017 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 382/747] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:02 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1372 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:02.986737 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-91ea08be-72cf-47a5-8fa5-dc4a311bbad9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:02.987431 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-91ea08be-72cf-47a5-8fa5-dc4a311bbad9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:03.090848 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-5ba8b528-80d1-4b2a-95a6-fd668fe528cd req-f23f904e-39a6-4a54-99f8-0f90220a874a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe4a882-7b2b-4cfb-99f2-b722277d132c", "tag": "d05de053-6bc4-4262-992c-723e87e69ddf"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:31:03.101852 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-5ba8b528-80d1-4b2a-95a6-fd668fe528cd req-f23f904e-39a6-4a54-99f8-0f90220a874a service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:03.103869 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-5ba8b528-80d1-4b2a-95a6-fd668fe528cd req-f23f904e-39a6-4a54-99f8-0f90220a874a service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:03.120884 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-5ba8b528-80d1-4b2a-95a6-fd668fe528cd req-f23f904e-39a6-4a54-99f8-0f90220a874a service nova] Creating event network-changed:d05de053-6bc4-4262-992c-723e87e69ddf for instance afe4a882-7b2b-4cfb-99f2-b722277d132c on hv-cinder-84178 May 13 17:31:03.126905 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-5ba8b528-80d1-4b2a-95a6-fd668fe528cd req-f23f904e-39a6-4a54-99f8-0f90220a874a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042031 May 13 17:31:03.127857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 383/748] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:31:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:31:03.136709 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-25caa2fa-ed1a-489f-af77-c91e359dab62 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:03.138452 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-25caa2fa-ed1a-489f-af77-c91e359dab62 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:03.149861 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-25caa2fa-ed1a-489f-af77-c91e359dab62 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:03.150507 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-25caa2fa-ed1a-489f-af77-c91e359dab62 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:03.151567 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-25caa2fa-ed1a-489f-af77-c91e359dab62 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:03.152470 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-25caa2fa-ed1a-489f-af77-c91e359dab62 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:03.196547 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-91ea08be-72cf-47a5-8fa5-dc4a311bbad9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:03.213179 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-91ea08be-72cf-47a5-8fa5-dc4a311bbad9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:03.221493 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-91ea08be-72cf-47a5-8fa5-dc4a311bbad9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:03.223770 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-91ea08be-72cf-47a5-8fa5-dc4a311bbad9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1739 microversion: 2.20 time: 0.262794 May 13 17:31:03.224864 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 366/749] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:02 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1739 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:31:03.679100 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-25caa2fa-ed1a-489f-af77-c91e359dab62 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:03.691414 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-25caa2fa-ed1a-489f-af77-c91e359dab62 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1724 microversion: 2.1 time: 0.562082 May 13 17:31:03.692293 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 384/750] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:03 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1724 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:04.002144 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-258f69e7-654a-46d8-8f56-e76c229629da tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:04.002833 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-258f69e7-654a-46d8-8f56-e76c229629da tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:04.011937 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-258f69e7-654a-46d8-8f56-e76c229629da tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:04.012376 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-258f69e7-654a-46d8-8f56-e76c229629da tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:04.013248 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-258f69e7-654a-46d8-8f56-e76c229629da tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:04.019280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-258f69e7-654a-46d8-8f56-e76c229629da tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:04.202258 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-258f69e7-654a-46d8-8f56-e76c229629da tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:04.211185 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-258f69e7-654a-46d8-8f56-e76c229629da tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1372 microversion: 2.1 time: 0.213051 May 13 17:31:04.220938 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 367/751] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:03 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1372 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:04.243771 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-42a2c371-3487-402c-b5fa-834da1f207ce tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:04.244560 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-42a2c371-3487-402c-b5fa-834da1f207ce tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:04.251873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-42a2c371-3487-402c-b5fa-834da1f207ce tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:04.252564 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-42a2c371-3487-402c-b5fa-834da1f207ce tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:04.253386 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-42a2c371-3487-402c-b5fa-834da1f207ce tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:04.253985 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-42a2c371-3487-402c-b5fa-834da1f207ce tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:04.471016 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-42a2c371-3487-402c-b5fa-834da1f207ce tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:04.490740 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-42a2c371-3487-402c-b5fa-834da1f207ce tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:04.492727 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-42a2c371-3487-402c-b5fa-834da1f207ce tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:04.494014 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-42a2c371-3487-402c-b5fa-834da1f207ce tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1739 microversion: 2.20 time: 0.256177 May 13 17:31:04.494683 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 385/752] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:04 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1739 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:04.712703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-96a2e50b-a4e9-44e0-bbcd-b02ba8118b87 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:04.713373 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-96a2e50b-a4e9-44e0-bbcd-b02ba8118b87 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:04.719806 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-96a2e50b-a4e9-44e0-bbcd-b02ba8118b87 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:04.720415 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-96a2e50b-a4e9-44e0-bbcd-b02ba8118b87 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:04.721139 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-96a2e50b-a4e9-44e0-bbcd-b02ba8118b87 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:04.721916 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-96a2e50b-a4e9-44e0-bbcd-b02ba8118b87 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:04.865499 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-96a2e50b-a4e9-44e0-bbcd-b02ba8118b87 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:04.874629 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-96a2e50b-a4e9-44e0-bbcd-b02ba8118b87 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1724 microversion: 2.1 time: 0.166549 May 13 17:31:04.875398 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 368/753] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:04 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:05.228691 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1d5d861f-cc06-44f7-9b7e-3d732f74dae3 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:05.229815 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1d5d861f-cc06-44f7-9b7e-3d732f74dae3 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:05.236985 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1d5d861f-cc06-44f7-9b7e-3d732f74dae3 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:05.237689 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1d5d861f-cc06-44f7-9b7e-3d732f74dae3 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:05.238856 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1d5d861f-cc06-44f7-9b7e-3d732f74dae3 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:05.239383 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1d5d861f-cc06-44f7-9b7e-3d732f74dae3 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:05.398025 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1d5d861f-cc06-44f7-9b7e-3d732f74dae3 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:05.407886 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1d5d861f-cc06-44f7-9b7e-3d732f74dae3 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1372 microversion: 2.1 time: 0.183777 May 13 17:31:05.419153 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 386/754] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:05 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1372 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:05.516155 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-427098cd-76e6-40d0-be3d-d2ac42387aa4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:05.517368 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-427098cd-76e6-40d0-be3d-d2ac42387aa4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:05.523790 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-427098cd-76e6-40d0-be3d-d2ac42387aa4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:05.525028 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-427098cd-76e6-40d0-be3d-d2ac42387aa4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:05.526464 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-427098cd-76e6-40d0-be3d-d2ac42387aa4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:05.527334 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-427098cd-76e6-40d0-be3d-d2ac42387aa4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:05.707751 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-427098cd-76e6-40d0-be3d-d2ac42387aa4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:05.716449 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-427098cd-76e6-40d0-be3d-d2ac42387aa4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:05.718935 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-427098cd-76e6-40d0-be3d-d2ac42387aa4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:05.720388 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-427098cd-76e6-40d0-be3d-d2ac42387aa4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1739 microversion: 2.20 time: 0.208138 May 13 17:31:05.721575 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 369/755] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:05 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1739 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:05.894139 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d2131a76-3ad7-4004-b4c8-f3f586fd99e0 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:05.895014 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d2131a76-3ad7-4004-b4c8-f3f586fd99e0 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:05.916572 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d2131a76-3ad7-4004-b4c8-f3f586fd99e0 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:05.917624 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d2131a76-3ad7-4004-b4c8-f3f586fd99e0 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:05.918712 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d2131a76-3ad7-4004-b4c8-f3f586fd99e0 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:05.919466 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d2131a76-3ad7-4004-b4c8-f3f586fd99e0 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:06.265573 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d2131a76-3ad7-4004-b4c8-f3f586fd99e0 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:06.276877 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d2131a76-3ad7-4004-b4c8-f3f586fd99e0 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1724 microversion: 2.1 time: 0.384850 May 13 17:31:06.276877 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 387/756] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:05 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1724 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:31:06.541967 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6f36bd0c-603f-41da-a4cd-2a7d929c4567 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:06.541967 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6f36bd0c-603f-41da-a4cd-2a7d929c4567 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:06.541967 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6f36bd0c-603f-41da-a4cd-2a7d929c4567 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:06.541967 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6f36bd0c-603f-41da-a4cd-2a7d929c4567 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:06.543770 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6f36bd0c-603f-41da-a4cd-2a7d929c4567 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:06.543770 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6f36bd0c-603f-41da-a4cd-2a7d929c4567 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:06.578097 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6f36bd0c-603f-41da-a4cd-2a7d929c4567 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:06.585969 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6f36bd0c-603f-41da-a4cd-2a7d929c4567 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1372 microversion: 2.1 time: 0.164057 May 13 17:31:06.586593 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 370/757] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:06 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1372 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:06.746940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ddbf2ed6-3f01-4d26-bfda-44b228329988 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:06.747671 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ddbf2ed6-3f01-4d26-bfda-44b228329988 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:06.753698 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ddbf2ed6-3f01-4d26-bfda-44b228329988 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:06.754154 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ddbf2ed6-3f01-4d26-bfda-44b228329988 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:06.754927 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ddbf2ed6-3f01-4d26-bfda-44b228329988 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:06.755405 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ddbf2ed6-3f01-4d26-bfda-44b228329988 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:06.911532 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ddbf2ed6-3f01-4d26-bfda-44b228329988 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:06.919232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ddbf2ed6-3f01-4d26-bfda-44b228329988 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:06.920725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ddbf2ed6-3f01-4d26-bfda-44b228329988 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:06.921876 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ddbf2ed6-3f01-4d26-bfda-44b228329988 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1739 microversion: 2.20 time: 0.178958 May 13 17:31:06.922437 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 388/758] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:06 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1739 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:07.292849 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d34c1ce2-8a80-4842-ad25-638072995ea8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:07.300218 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d34c1ce2-8a80-4842-ad25-638072995ea8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:07.306245 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d34c1ce2-8a80-4842-ad25-638072995ea8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:07.306930 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d34c1ce2-8a80-4842-ad25-638072995ea8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:07.307901 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d34c1ce2-8a80-4842-ad25-638072995ea8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:07.308496 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d34c1ce2-8a80-4842-ad25-638072995ea8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:07.453080 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d34c1ce2-8a80-4842-ad25-638072995ea8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:07.462164 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d34c1ce2-8a80-4842-ad25-638072995ea8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1724 microversion: 2.1 time: 0.174382 May 13 17:31:07.463741 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 371/759] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:07 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:07.604169 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-dbb0abb6-c5a3-474d-af89-2bd8dc527aed tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:07.604821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-dbb0abb6-c5a3-474d-af89-2bd8dc527aed tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:07.613542 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dbb0abb6-c5a3-474d-af89-2bd8dc527aed tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:07.616126 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dbb0abb6-c5a3-474d-af89-2bd8dc527aed tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:07.616126 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dbb0abb6-c5a3-474d-af89-2bd8dc527aed tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:07.616126 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dbb0abb6-c5a3-474d-af89-2bd8dc527aed tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:07.789868 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-dbb0abb6-c5a3-474d-af89-2bd8dc527aed tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:07.798017 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-dbb0abb6-c5a3-474d-af89-2bd8dc527aed tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1372 microversion: 2.1 time: 0.198399 May 13 17:31:07.799015 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 389/760] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:07 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1372 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:07.942925 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-31285c9a-c43c-4908-b5e6-0e6a9d1cf258 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:07.944882 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-31285c9a-c43c-4908-b5e6-0e6a9d1cf258 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:07.952568 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-31285c9a-c43c-4908-b5e6-0e6a9d1cf258 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:07.953273 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-31285c9a-c43c-4908-b5e6-0e6a9d1cf258 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:07.960967 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-31285c9a-c43c-4908-b5e6-0e6a9d1cf258 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:07.961748 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-31285c9a-c43c-4908-b5e6-0e6a9d1cf258 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:08.124786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-31285c9a-c43c-4908-b5e6-0e6a9d1cf258 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:08.134199 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-31285c9a-c43c-4908-b5e6-0e6a9d1cf258 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:08.136214 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-31285c9a-c43c-4908-b5e6-0e6a9d1cf258 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:08.137592 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-31285c9a-c43c-4908-b5e6-0e6a9d1cf258 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1739 microversion: 2.20 time: 0.200156 May 13 17:31:08.138437 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 372/761] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:07 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:08.486739 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-978b691c-e5b4-4332-8540-75b46da5556b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:08.487382 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-978b691c-e5b4-4332-8540-75b46da5556b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:08.494007 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-978b691c-e5b4-4332-8540-75b46da5556b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:08.494461 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-978b691c-e5b4-4332-8540-75b46da5556b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:08.495317 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-978b691c-e5b4-4332-8540-75b46da5556b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:08.495761 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-978b691c-e5b4-4332-8540-75b46da5556b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:08.649028 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-978b691c-e5b4-4332-8540-75b46da5556b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:08.657304 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-978b691c-e5b4-4332-8540-75b46da5556b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1724 microversion: 2.1 time: 0.174329 May 13 17:31:08.658393 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 390/762] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:08 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:31:08.815727 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-92636e89-2628-4344-827f-5f56008a84bf tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:08.816372 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-92636e89-2628-4344-827f-5f56008a84bf tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:08.822780 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-92636e89-2628-4344-827f-5f56008a84bf tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:08.823265 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-92636e89-2628-4344-827f-5f56008a84bf tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:08.824056 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-92636e89-2628-4344-827f-5f56008a84bf tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:08.824493 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-92636e89-2628-4344-827f-5f56008a84bf tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:08.954088 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-92636e89-2628-4344-827f-5f56008a84bf tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:08.962666 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-92636e89-2628-4344-827f-5f56008a84bf tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1372 microversion: 2.1 time: 0.151317 May 13 17:31:08.963257 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 373/763] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:08 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1372 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:09.156950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6395b251-18aa-46c9-a452-7619c4359d17 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:09.157923 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6395b251-18aa-46c9-a452-7619c4359d17 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:09.164829 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6395b251-18aa-46c9-a452-7619c4359d17 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:09.165281 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6395b251-18aa-46c9-a452-7619c4359d17 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:09.166142 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6395b251-18aa-46c9-a452-7619c4359d17 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:09.166682 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6395b251-18aa-46c9-a452-7619c4359d17 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:09.306354 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6395b251-18aa-46c9-a452-7619c4359d17 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:09.316306 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6395b251-18aa-46c9-a452-7619c4359d17 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:09.317788 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6395b251-18aa-46c9-a452-7619c4359d17 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:09.319014 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6395b251-18aa-46c9-a452-7619c4359d17 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1739 microversion: 2.20 time: 0.165926 May 13 17:31:09.320529 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 391/764] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:09 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1739 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:09.675377 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-dc9f16a6-faa7-4638-9e8f-6a93a83f4a55 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:09.676176 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-dc9f16a6-faa7-4638-9e8f-6a93a83f4a55 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:09.683094 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dc9f16a6-faa7-4638-9e8f-6a93a83f4a55 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:09.683577 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dc9f16a6-faa7-4638-9e8f-6a93a83f4a55 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:09.684375 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dc9f16a6-faa7-4638-9e8f-6a93a83f4a55 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:09.684798 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dc9f16a6-faa7-4638-9e8f-6a93a83f4a55 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:09.856181 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-dc9f16a6-faa7-4638-9e8f-6a93a83f4a55 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:09.864274 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-dc9f16a6-faa7-4638-9e8f-6a93a83f4a55 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1724 microversion: 2.1 time: 0.192928 May 13 17:31:09.864857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 374/765] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:09 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:09.982406 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-11abdd6f-fab6-4aea-9aac-a2508d31f177 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:09.983077 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-11abdd6f-fab6-4aea-9aac-a2508d31f177 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:09.996173 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-11abdd6f-fab6-4aea-9aac-a2508d31f177 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:09.996976 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-11abdd6f-fab6-4aea-9aac-a2508d31f177 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:09.997584 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-11abdd6f-fab6-4aea-9aac-a2508d31f177 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:09.998033 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-11abdd6f-fab6-4aea-9aac-a2508d31f177 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:10.156678 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-11abdd6f-fab6-4aea-9aac-a2508d31f177 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:10.165209 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-11abdd6f-fab6-4aea-9aac-a2508d31f177 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1372 microversion: 2.1 time: 0.187358 May 13 17:31:10.165851 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 392/766] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:09 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1372 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:10.338385 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f1a20dcf-267a-422f-89a2-df0479bab357 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:10.338979 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-f1a20dcf-267a-422f-89a2-df0479bab357 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:10.364679 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f1a20dcf-267a-422f-89a2-df0479bab357 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:10.364679 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f1a20dcf-267a-422f-89a2-df0479bab357 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:10.364679 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f1a20dcf-267a-422f-89a2-df0479bab357 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:10.364679 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f1a20dcf-267a-422f-89a2-df0479bab357 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:10.481854 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f1a20dcf-267a-422f-89a2-df0479bab357 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:10.489502 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f1a20dcf-267a-422f-89a2-df0479bab357 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:10.491041 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f1a20dcf-267a-422f-89a2-df0479bab357 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:10.492227 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f1a20dcf-267a-422f-89a2-df0479bab357 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1739 microversion: 2.20 time: 0.158267 May 13 17:31:10.492815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 375/767] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:10 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:10.883660 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f5f133fe-b76c-4c05-b805-7bc6af0eb8f2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:10.884708 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f5f133fe-b76c-4c05-b805-7bc6af0eb8f2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:10.891727 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f5f133fe-b76c-4c05-b805-7bc6af0eb8f2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:10.892187 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f5f133fe-b76c-4c05-b805-7bc6af0eb8f2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:10.893030 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f5f133fe-b76c-4c05-b805-7bc6af0eb8f2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:10.893477 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f5f133fe-b76c-4c05-b805-7bc6af0eb8f2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:11.094433 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f5f133fe-b76c-4c05-b805-7bc6af0eb8f2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:11.103990 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f5f133fe-b76c-4c05-b805-7bc6af0eb8f2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1724 microversion: 2.1 time: 0.225450 May 13 17:31:11.105007 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 393/768] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:10 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:11.182056 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d3f414dd-18f8-432b-b76e-db789b9f2160 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:11.182595 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d3f414dd-18f8-432b-b76e-db789b9f2160 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:11.188935 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d3f414dd-18f8-432b-b76e-db789b9f2160 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:11.189384 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d3f414dd-18f8-432b-b76e-db789b9f2160 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:11.190165 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d3f414dd-18f8-432b-b76e-db789b9f2160 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:11.190606 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d3f414dd-18f8-432b-b76e-db789b9f2160 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:11.362003 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d3f414dd-18f8-432b-b76e-db789b9f2160 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:11.370867 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d3f414dd-18f8-432b-b76e-db789b9f2160 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1372 microversion: 2.1 time: 0.192425 May 13 17:31:11.371781 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 376/769] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:11 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1372 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:11.526889 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-04f5c16e-c7ba-43a7-9241-79ca15a65029 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:11.528778 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-04f5c16e-c7ba-43a7-9241-79ca15a65029 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:11.554751 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-04f5c16e-c7ba-43a7-9241-79ca15a65029 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:11.555828 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-04f5c16e-c7ba-43a7-9241-79ca15a65029 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:11.560489 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-04f5c16e-c7ba-43a7-9241-79ca15a65029 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:11.561959 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-04f5c16e-c7ba-43a7-9241-79ca15a65029 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:11.735918 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-04f5c16e-c7ba-43a7-9241-79ca15a65029 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:11.745318 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-04f5c16e-c7ba-43a7-9241-79ca15a65029 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:11.746820 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-04f5c16e-c7ba-43a7-9241-79ca15a65029 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:11.748530 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-04f5c16e-c7ba-43a7-9241-79ca15a65029 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1739 microversion: 2.20 time: 0.242176 May 13 17:31:11.759746 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 394/770] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:11 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1739 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:12.124357 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-48c4b6c8-8148-48a9-b471-f457f49dc867 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:12.125044 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-48c4b6c8-8148-48a9-b471-f457f49dc867 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:12.133834 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-48c4b6c8-8148-48a9-b471-f457f49dc867 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:12.134283 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-48c4b6c8-8148-48a9-b471-f457f49dc867 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:12.138533 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-48c4b6c8-8148-48a9-b471-f457f49dc867 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:12.138988 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-48c4b6c8-8148-48a9-b471-f457f49dc867 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:12.281977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-48c4b6c8-8148-48a9-b471-f457f49dc867 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:12.292703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-48c4b6c8-8148-48a9-b471-f457f49dc867 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1724 microversion: 2.1 time: 0.172611 May 13 17:31:12.293730 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 377/771] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:12 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:12.388895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e288639d-e255-47f0-ab4d-200f666a4026 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:12.390221 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e288639d-e255-47f0-ab4d-200f666a4026 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:12.398033 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e288639d-e255-47f0-ab4d-200f666a4026 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:12.398484 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e288639d-e255-47f0-ab4d-200f666a4026 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:12.399314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e288639d-e255-47f0-ab4d-200f666a4026 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:12.399892 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e288639d-e255-47f0-ab4d-200f666a4026 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:12.579138 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e288639d-e255-47f0-ab4d-200f666a4026 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:12.587986 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e288639d-e255-47f0-ab4d-200f666a4026 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1372 microversion: 2.1 time: 0.203524 May 13 17:31:12.588597 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 395/772] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:12 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1372 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:12.734176 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-9924b2be-d9cb-4231-85bd-6c9fcaace227 req-5edaf26e-b440-4bd3-8457-fcf7a64215c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe4a882-7b2b-4cfb-99f2-b722277d132c", "name": "network-vif-plugged", "status": "completed", "tag": "d05de053-6bc4-4262-992c-723e87e69ddf"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:31:12.751283 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-9924b2be-d9cb-4231-85bd-6c9fcaace227 req-5edaf26e-b440-4bd3-8457-fcf7a64215c6 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:12.752045 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-9924b2be-d9cb-4231-85bd-6c9fcaace227 req-5edaf26e-b440-4bd3-8457-fcf7a64215c6 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:12.763913 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-9924b2be-d9cb-4231-85bd-6c9fcaace227 req-5edaf26e-b440-4bd3-8457-fcf7a64215c6 service nova] Creating event network-vif-plugged:d05de053-6bc4-4262-992c-723e87e69ddf for instance afe4a882-7b2b-4cfb-99f2-b722277d132c on hv-cinder-84178 May 13 17:31:12.769779 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-790eeba6-a0a4-4784-98f9-3055585cbc36 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:12.770852 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-790eeba6-a0a4-4784-98f9-3055585cbc36 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:12.778527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-790eeba6-a0a4-4784-98f9-3055585cbc36 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:12.778974 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-790eeba6-a0a4-4784-98f9-3055585cbc36 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:12.779783 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-790eeba6-a0a4-4784-98f9-3055585cbc36 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:12.780224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-790eeba6-a0a4-4784-98f9-3055585cbc36 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:12.786380 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-9924b2be-d9cb-4231-85bd-6c9fcaace227 req-5edaf26e-b440-4bd3-8457-fcf7a64215c6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055780 May 13 17:31:12.787552 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 378/773] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:31:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:31:12.954512 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-790eeba6-a0a4-4784-98f9-3055585cbc36 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:12.967909 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-790eeba6-a0a4-4784-98f9-3055585cbc36 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:12.974437 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-790eeba6-a0a4-4784-98f9-3055585cbc36 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:12.974437 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-790eeba6-a0a4-4784-98f9-3055585cbc36 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1739 microversion: 2.20 time: 0.204810 May 13 17:31:12.974437 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 396/774] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:12 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:31:13.314085 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a8860b62-354d-4466-9bcf-225ef5d0c22b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:13.314700 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a8860b62-354d-4466-9bcf-225ef5d0c22b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:13.321939 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a8860b62-354d-4466-9bcf-225ef5d0c22b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:13.322386 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a8860b62-354d-4466-9bcf-225ef5d0c22b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:13.323177 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a8860b62-354d-4466-9bcf-225ef5d0c22b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:13.323636 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a8860b62-354d-4466-9bcf-225ef5d0c22b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:13.459138 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a8860b62-354d-4466-9bcf-225ef5d0c22b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:13.470299 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a8860b62-354d-4466-9bcf-225ef5d0c22b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1724 microversion: 2.1 time: 0.161354 May 13 17:31:13.470896 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 379/775] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:13 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:13.605628 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4bb2ed6c-1f7d-460a-80bd-7e7f9aa67afd tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:13.606232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4bb2ed6c-1f7d-460a-80bd-7e7f9aa67afd tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:13.612668 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4bb2ed6c-1f7d-460a-80bd-7e7f9aa67afd tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:13.630662 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4bb2ed6c-1f7d-460a-80bd-7e7f9aa67afd tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:13.630662 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4bb2ed6c-1f7d-460a-80bd-7e7f9aa67afd tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:13.630662 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4bb2ed6c-1f7d-460a-80bd-7e7f9aa67afd tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:13.744756 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4bb2ed6c-1f7d-460a-80bd-7e7f9aa67afd tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:13.751986 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4bb2ed6c-1f7d-460a-80bd-7e7f9aa67afd tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1372 microversion: 2.1 time: 0.150200 May 13 17:31:13.752546 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 397/776] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:13 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:13.988867 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-c3d157b2-045a-4ec0-8bc2-1e4de090a05d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:13.989506 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-c3d157b2-045a-4ec0-8bc2-1e4de090a05d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:13.996526 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c3d157b2-045a-4ec0-8bc2-1e4de090a05d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:13.996978 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c3d157b2-045a-4ec0-8bc2-1e4de090a05d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:13.997754 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c3d157b2-045a-4ec0-8bc2-1e4de090a05d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:13.998196 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c3d157b2-045a-4ec0-8bc2-1e4de090a05d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:14.125713 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c3d157b2-045a-4ec0-8bc2-1e4de090a05d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:14.133581 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c3d157b2-045a-4ec0-8bc2-1e4de090a05d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:14.135079 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c3d157b2-045a-4ec0-8bc2-1e4de090a05d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:14.136666 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-c3d157b2-045a-4ec0-8bc2-1e4de090a05d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1739 microversion: 2.20 time: 0.151535 May 13 17:31:14.137328 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 380/777] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:13 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1739 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:14.488269 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3115a1a0-3819-4240-a5e9-e9294a5b9f66 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:14.488889 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3115a1a0-3819-4240-a5e9-e9294a5b9f66 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:14.495015 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3115a1a0-3819-4240-a5e9-e9294a5b9f66 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:14.495505 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3115a1a0-3819-4240-a5e9-e9294a5b9f66 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:14.496453 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3115a1a0-3819-4240-a5e9-e9294a5b9f66 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:14.496899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3115a1a0-3819-4240-a5e9-e9294a5b9f66 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:14.634851 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3115a1a0-3819-4240-a5e9-e9294a5b9f66 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:14.643092 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3115a1a0-3819-4240-a5e9-e9294a5b9f66 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1724 microversion: 2.1 time: 0.159119 May 13 17:31:14.654592 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 398/778] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:14 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:14.769267 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-83d14ffb-f824-4a34-867f-96419bc108a6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:14.769804 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-83d14ffb-f824-4a34-867f-96419bc108a6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:14.775762 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-83d14ffb-f824-4a34-867f-96419bc108a6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:14.776214 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-83d14ffb-f824-4a34-867f-96419bc108a6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:14.776976 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-83d14ffb-f824-4a34-867f-96419bc108a6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:14.777410 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-83d14ffb-f824-4a34-867f-96419bc108a6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:14.902010 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-83d14ffb-f824-4a34-867f-96419bc108a6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:14.909927 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-83d14ffb-f824-4a34-867f-96419bc108a6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1372 microversion: 2.1 time: 0.144539 May 13 17:31:14.910500 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 381/779] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:14 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1372 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:15.155611 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-648f271a-5002-431c-ab6a-3b426792c97d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:15.156216 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-648f271a-5002-431c-ab6a-3b426792c97d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:15.161999 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-648f271a-5002-431c-ab6a-3b426792c97d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:15.162446 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-648f271a-5002-431c-ab6a-3b426792c97d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:15.163746 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-648f271a-5002-431c-ab6a-3b426792c97d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:15.164188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-648f271a-5002-431c-ab6a-3b426792c97d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:15.298121 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-648f271a-5002-431c-ab6a-3b426792c97d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:15.306513 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-648f271a-5002-431c-ab6a-3b426792c97d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:15.308042 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-648f271a-5002-431c-ab6a-3b426792c97d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:15.309197 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-648f271a-5002-431c-ab6a-3b426792c97d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1739 microversion: 2.20 time: 0.157490 May 13 17:31:15.309762 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 399/780] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:15 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:15.662046 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b236ad19-7a94-40ee-9083-f8d5a7152829 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:15.662649 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b236ad19-7a94-40ee-9083-f8d5a7152829 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:15.669534 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b236ad19-7a94-40ee-9083-f8d5a7152829 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:15.669974 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b236ad19-7a94-40ee-9083-f8d5a7152829 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:15.670732 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b236ad19-7a94-40ee-9083-f8d5a7152829 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:15.671185 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b236ad19-7a94-40ee-9083-f8d5a7152829 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:15.797384 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b236ad19-7a94-40ee-9083-f8d5a7152829 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:15.805211 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b236ad19-7a94-40ee-9083-f8d5a7152829 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1724 microversion: 2.1 time: 0.146986 May 13 17:31:15.805782 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 382/781] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:15 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:15.925852 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d5ab0b57-ea9e-4147-89ec-0dc0f396749d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:15.926466 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d5ab0b57-ea9e-4147-89ec-0dc0f396749d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:15.932922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d5ab0b57-ea9e-4147-89ec-0dc0f396749d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:15.933379 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d5ab0b57-ea9e-4147-89ec-0dc0f396749d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:15.934145 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d5ab0b57-ea9e-4147-89ec-0dc0f396749d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:15.934588 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d5ab0b57-ea9e-4147-89ec-0dc0f396749d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:16.076551 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d5ab0b57-ea9e-4147-89ec-0dc0f396749d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:16.083771 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d5ab0b57-ea9e-4147-89ec-0dc0f396749d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1372 microversion: 2.1 time: 0.161700 May 13 17:31:16.084332 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 400/782] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:15 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1372 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:16.327421 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f082f3b3-cf15-48dc-9728-0d330de0aabe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:16.328031 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-f082f3b3-cf15-48dc-9728-0d330de0aabe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:16.334039 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f082f3b3-cf15-48dc-9728-0d330de0aabe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:16.334487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f082f3b3-cf15-48dc-9728-0d330de0aabe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:16.335283 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f082f3b3-cf15-48dc-9728-0d330de0aabe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:16.335720 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f082f3b3-cf15-48dc-9728-0d330de0aabe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:16.462818 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f082f3b3-cf15-48dc-9728-0d330de0aabe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:16.470491 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f082f3b3-cf15-48dc-9728-0d330de0aabe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:16.472287 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f082f3b3-cf15-48dc-9728-0d330de0aabe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:16.473436 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f082f3b3-cf15-48dc-9728-0d330de0aabe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1739 microversion: 2.20 time: 0.150054 May 13 17:31:16.474019 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 383/783] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:16 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1739 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:16.821883 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-302dec5d-80a0-44fd-90c0-01a71ba71ec1 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:16.822546 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-302dec5d-80a0-44fd-90c0-01a71ba71ec1 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:16.828407 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-302dec5d-80a0-44fd-90c0-01a71ba71ec1 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:16.828864 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-302dec5d-80a0-44fd-90c0-01a71ba71ec1 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:16.829656 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-302dec5d-80a0-44fd-90c0-01a71ba71ec1 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:16.830095 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-302dec5d-80a0-44fd-90c0-01a71ba71ec1 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:16.968023 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-302dec5d-80a0-44fd-90c0-01a71ba71ec1 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:16.976533 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-302dec5d-80a0-44fd-90c0-01a71ba71ec1 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1724 microversion: 2.1 time: 0.157947 May 13 17:31:16.977105 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 401/784] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:16 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:17.101842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-78ac92f9-32b7-4b66-a822-8c610631d25e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:17.102454 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-78ac92f9-32b7-4b66-a822-8c610631d25e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:17.108763 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-78ac92f9-32b7-4b66-a822-8c610631d25e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:17.109208 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-78ac92f9-32b7-4b66-a822-8c610631d25e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:17.109969 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-78ac92f9-32b7-4b66-a822-8c610631d25e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:17.110402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-78ac92f9-32b7-4b66-a822-8c610631d25e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:17.237649 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-78ac92f9-32b7-4b66-a822-8c610631d25e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:17.244830 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-78ac92f9-32b7-4b66-a822-8c610631d25e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1372 microversion: 2.1 time: 0.147713 May 13 17:31:17.245404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 384/785] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:17 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1372 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:31:17.491964 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-01c354be-e223-48c5-a03d-ef6f1268c897 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:17.492489 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-01c354be-e223-48c5-a03d-ef6f1268c897 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:17.498301 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-01c354be-e223-48c5-a03d-ef6f1268c897 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:17.500747 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-01c354be-e223-48c5-a03d-ef6f1268c897 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:17.500747 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-01c354be-e223-48c5-a03d-ef6f1268c897 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:17.500747 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-01c354be-e223-48c5-a03d-ef6f1268c897 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:17.626794 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-01c354be-e223-48c5-a03d-ef6f1268c897 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:17.633990 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-01c354be-e223-48c5-a03d-ef6f1268c897 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:17.635515 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-01c354be-e223-48c5-a03d-ef6f1268c897 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:17.636670 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-01c354be-e223-48c5-a03d-ef6f1268c897 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1739 microversion: 2.20 time: 0.148736 May 13 17:31:17.637238 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 402/786] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:17 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1739 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:17.994176 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6aa7cc3f-c4b5-4851-86b5-0320df99bb8c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:17.994786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6aa7cc3f-c4b5-4851-86b5-0320df99bb8c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:18.000958 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6aa7cc3f-c4b5-4851-86b5-0320df99bb8c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:18.001357 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6aa7cc3f-c4b5-4851-86b5-0320df99bb8c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:18.002127 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6aa7cc3f-c4b5-4851-86b5-0320df99bb8c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:18.002614 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6aa7cc3f-c4b5-4851-86b5-0320df99bb8c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:18.138201 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6aa7cc3f-c4b5-4851-86b5-0320df99bb8c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:18.146208 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6aa7cc3f-c4b5-4851-86b5-0320df99bb8c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1724 microversion: 2.1 time: 0.156541 May 13 17:31:18.146779 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 385/787] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:17 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:18.261407 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-76fdeee4-8aa1-4364-8a17-0368c86f20a5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:18.261921 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-76fdeee4-8aa1-4364-8a17-0368c86f20a5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:18.268230 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-76fdeee4-8aa1-4364-8a17-0368c86f20a5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:18.268675 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-76fdeee4-8aa1-4364-8a17-0368c86f20a5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:18.269429 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-76fdeee4-8aa1-4364-8a17-0368c86f20a5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:18.269862 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-76fdeee4-8aa1-4364-8a17-0368c86f20a5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:18.399336 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-76fdeee4-8aa1-4364-8a17-0368c86f20a5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:18.406552 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-76fdeee4-8aa1-4364-8a17-0368c86f20a5 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1372 microversion: 2.1 time: 0.149038 May 13 17:31:18.411186 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 403/788] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:18 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:31:18.654800 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-c08c0334-ee80-4400-9acf-f2b36a6e9e32 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:18.655440 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-c08c0334-ee80-4400-9acf-f2b36a6e9e32 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:18.661344 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c08c0334-ee80-4400-9acf-f2b36a6e9e32 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:18.661791 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c08c0334-ee80-4400-9acf-f2b36a6e9e32 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:18.662556 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c08c0334-ee80-4400-9acf-f2b36a6e9e32 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:18.663001 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c08c0334-ee80-4400-9acf-f2b36a6e9e32 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:18.790304 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c08c0334-ee80-4400-9acf-f2b36a6e9e32 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:18.798617 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c08c0334-ee80-4400-9acf-f2b36a6e9e32 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:18.800110 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c08c0334-ee80-4400-9acf-f2b36a6e9e32 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:18.801252 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-c08c0334-ee80-4400-9acf-f2b36a6e9e32 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1721 microversion: 2.20 time: 0.150371 May 13 17:31:18.801813 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 386/789] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:18 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:19.162978 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5f691846-ec43-4335-b7cc-2cbadbe93033 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:19.163621 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5f691846-ec43-4335-b7cc-2cbadbe93033 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:19.169438 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5f691846-ec43-4335-b7cc-2cbadbe93033 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:19.169891 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5f691846-ec43-4335-b7cc-2cbadbe93033 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:19.170659 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5f691846-ec43-4335-b7cc-2cbadbe93033 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:19.171100 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5f691846-ec43-4335-b7cc-2cbadbe93033 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:19.310862 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5f691846-ec43-4335-b7cc-2cbadbe93033 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:19.318649 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5f691846-ec43-4335-b7cc-2cbadbe93033 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1724 microversion: 2.1 time: 0.159441 May 13 17:31:19.319240 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 404/790] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:19 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:19.423753 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-ed686322-4689-4cd5-b98b-095afae52a79 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:19.424361 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-ed686322-4689-4cd5-b98b-095afae52a79 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:19.431246 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ed686322-4689-4cd5-b98b-095afae52a79 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:19.431701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ed686322-4689-4cd5-b98b-095afae52a79 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:19.432467 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ed686322-4689-4cd5-b98b-095afae52a79 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:19.432903 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ed686322-4689-4cd5-b98b-095afae52a79 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:19.558568 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-ed686322-4689-4cd5-b98b-095afae52a79 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:19.565775 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-ed686322-4689-4cd5-b98b-095afae52a79 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1372 microversion: 2.1 time: 0.145801 May 13 17:31:19.566348 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 387/791] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:19 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1372 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:19.819896 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-654004c3-86ec-4052-8998-33c877c994ea tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:19.820408 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-654004c3-86ec-4052-8998-33c877c994ea tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:19.826227 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-654004c3-86ec-4052-8998-33c877c994ea tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:19.826682 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-654004c3-86ec-4052-8998-33c877c994ea tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:19.827477 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-654004c3-86ec-4052-8998-33c877c994ea tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:19.827945 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-654004c3-86ec-4052-8998-33c877c994ea tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:19.958449 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-654004c3-86ec-4052-8998-33c877c994ea tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:19.966235 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-654004c3-86ec-4052-8998-33c877c994ea tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:19.967753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-654004c3-86ec-4052-8998-33c877c994ea tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:19.968911 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-654004c3-86ec-4052-8998-33c877c994ea tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1721 microversion: 2.20 time: 0.153009 May 13 17:31:19.969477 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 405/792] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:19 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:20.336510 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-32359185-a131-4c0d-9634-9e97c23679ce tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:20.337167 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-32359185-a131-4c0d-9634-9e97c23679ce tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:20.343202 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-32359185-a131-4c0d-9634-9e97c23679ce tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:20.343662 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-32359185-a131-4c0d-9634-9e97c23679ce tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:20.344437 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-32359185-a131-4c0d-9634-9e97c23679ce tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:20.344886 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-32359185-a131-4c0d-9634-9e97c23679ce tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:20.470873 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-32359185-a131-4c0d-9634-9e97c23679ce tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:20.478937 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-32359185-a131-4c0d-9634-9e97c23679ce tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1724 microversion: 2.1 time: 0.146691 May 13 17:31:20.479534 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 388/793] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:20 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:20.583345 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b084b504-0edf-4828-a28f-098c9f2118ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:20.584055 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b084b504-0edf-4828-a28f-098c9f2118ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:20.590977 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b084b504-0edf-4828-a28f-098c9f2118ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:20.591466 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b084b504-0edf-4828-a28f-098c9f2118ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:20.592232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b084b504-0edf-4828-a28f-098c9f2118ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:20.592669 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b084b504-0edf-4828-a28f-098c9f2118ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:20.720483 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b084b504-0edf-4828-a28f-098c9f2118ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:20.728190 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b084b504-0edf-4828-a28f-098c9f2118ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1372 microversion: 2.1 time: 0.148644 May 13 17:31:20.728776 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 406/794] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:20 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1372 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:20.988454 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-4af60223-cc7b-439e-9aaa-936904ec7873 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:20.989110 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-4af60223-cc7b-439e-9aaa-936904ec7873 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:20.996064 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4af60223-cc7b-439e-9aaa-936904ec7873 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:20.996525 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4af60223-cc7b-439e-9aaa-936904ec7873 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:20.997312 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4af60223-cc7b-439e-9aaa-936904ec7873 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:20.997756 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4af60223-cc7b-439e-9aaa-936904ec7873 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:21.148862 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-4af60223-cc7b-439e-9aaa-936904ec7873 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:21.157546 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-4af60223-cc7b-439e-9aaa-936904ec7873 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:21.159246 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-4af60223-cc7b-439e-9aaa-936904ec7873 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:21.160468 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-4af60223-cc7b-439e-9aaa-936904ec7873 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1721 microversion: 2.20 time: 0.176179 May 13 17:31:21.161115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 389/795] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:20 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:21.312713 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-66809c37-284a-4325-beb8-5379add4abbb req-6280512d-edc5-4cc6-a670-2759742b9627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65fdbf1a-f080-4d79-b3f3-c465e5a81c67", "name": "network-vif-unplugged", "status": "completed", "tag": "41053781-3367-4859-b7f7-eb83af021a82"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:31:21.321324 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-66809c37-284a-4325-beb8-5379add4abbb req-6280512d-edc5-4cc6-a670-2759742b9627 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:21.321762 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-66809c37-284a-4325-beb8-5379add4abbb req-6280512d-edc5-4cc6-a670-2759742b9627 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:21.334497 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-66809c37-284a-4325-beb8-5379add4abbb req-6280512d-edc5-4cc6-a670-2759742b9627 service nova] Creating event network-vif-unplugged:41053781-3367-4859-b7f7-eb83af021a82 for instance 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 on hv-cinder-84178 May 13 17:31:21.340133 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-66809c37-284a-4325-beb8-5379add4abbb req-6280512d-edc5-4cc6-a670-2759742b9627 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030565 May 13 17:31:21.340748 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 407/796] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:31:21.496790 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-350e6819-8990-4018-9a4e-4048e9751be2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:21.497474 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-350e6819-8990-4018-9a4e-4048e9751be2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:21.503807 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-350e6819-8990-4018-9a4e-4048e9751be2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:21.505460 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-350e6819-8990-4018-9a4e-4048e9751be2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:21.506674 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-350e6819-8990-4018-9a4e-4048e9751be2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:21.507149 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-350e6819-8990-4018-9a4e-4048e9751be2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:21.650202 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-350e6819-8990-4018-9a4e-4048e9751be2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:21.658276 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-350e6819-8990-4018-9a4e-4048e9751be2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1724 microversion: 2.1 time: 0.165448 May 13 17:31:21.658854 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 390/797] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:21 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:21.746183 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-dbcb7ae0-47fc-4a20-8f86-7f06ecff0f44 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:21.749679 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-dbcb7ae0-47fc-4a20-8f86-7f06ecff0f44 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:21.756379 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dbcb7ae0-47fc-4a20-8f86-7f06ecff0f44 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:21.756830 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dbcb7ae0-47fc-4a20-8f86-7f06ecff0f44 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:21.757651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dbcb7ae0-47fc-4a20-8f86-7f06ecff0f44 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:21.758095 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dbcb7ae0-47fc-4a20-8f86-7f06ecff0f44 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:21.887032 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-dbcb7ae0-47fc-4a20-8f86-7f06ecff0f44 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:21.894259 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-dbcb7ae0-47fc-4a20-8f86-7f06ecff0f44 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1372 microversion: 2.1 time: 0.152906 May 13 17:31:21.894835 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 408/798] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:21 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1372 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:22.178244 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-71c0ca1e-6fac-433d-8be9-ecf68d097f05 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:22.178885 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-71c0ca1e-6fac-433d-8be9-ecf68d097f05 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:22.184654 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-71c0ca1e-6fac-433d-8be9-ecf68d097f05 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:22.185109 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-71c0ca1e-6fac-433d-8be9-ecf68d097f05 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:22.185877 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-71c0ca1e-6fac-433d-8be9-ecf68d097f05 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:22.186316 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-71c0ca1e-6fac-433d-8be9-ecf68d097f05 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:22.311885 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-71c0ca1e-6fac-433d-8be9-ecf68d097f05 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:22.319442 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-71c0ca1e-6fac-433d-8be9-ecf68d097f05 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:22.321600 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-71c0ca1e-6fac-433d-8be9-ecf68d097f05 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:22.322738 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-71c0ca1e-6fac-433d-8be9-ecf68d097f05 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1721 microversion: 2.20 time: 0.148402 May 13 17:31:22.323314 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 391/799] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:22 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1721 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:31:22.676069 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-eb6787de-cc98-46c7-8b60-8bb3ec699772 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:22.676691 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-eb6787de-cc98-46c7-8b60-8bb3ec699772 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:22.682545 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eb6787de-cc98-46c7-8b60-8bb3ec699772 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:22.683002 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eb6787de-cc98-46c7-8b60-8bb3ec699772 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:22.683807 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eb6787de-cc98-46c7-8b60-8bb3ec699772 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:22.684254 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eb6787de-cc98-46c7-8b60-8bb3ec699772 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:22.807583 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-eb6787de-cc98-46c7-8b60-8bb3ec699772 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:22.815292 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-eb6787de-cc98-46c7-8b60-8bb3ec699772 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1724 microversion: 2.1 time: 0.143031 May 13 17:31:22.815856 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 409/800] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:22 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1724 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:31:22.910977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7db4f591-0b07-4df7-aa8e-99e859d2cc68 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:22.911643 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7db4f591-0b07-4df7-aa8e-99e859d2cc68 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:22.917973 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7db4f591-0b07-4df7-aa8e-99e859d2cc68 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:22.918424 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7db4f591-0b07-4df7-aa8e-99e859d2cc68 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:22.919367 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7db4f591-0b07-4df7-aa8e-99e859d2cc68 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:22.919857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7db4f591-0b07-4df7-aa8e-99e859d2cc68 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:23.046947 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7db4f591-0b07-4df7-aa8e-99e859d2cc68 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:23.054725 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7db4f591-0b07-4df7-aa8e-99e859d2cc68 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1372 microversion: 2.1 time: 0.147102 May 13 17:31:23.055311 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 392/801] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:22 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1372 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:23.341299 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-96207cb1-4ebd-4b5d-a683-42545e0a1e99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:23.341935 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-96207cb1-4ebd-4b5d-a683-42545e0a1e99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:23.348124 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-96207cb1-4ebd-4b5d-a683-42545e0a1e99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:23.348576 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-96207cb1-4ebd-4b5d-a683-42545e0a1e99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:23.349338 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-96207cb1-4ebd-4b5d-a683-42545e0a1e99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:23.349775 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-96207cb1-4ebd-4b5d-a683-42545e0a1e99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:23.478347 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-96207cb1-4ebd-4b5d-a683-42545e0a1e99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:23.485975 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-96207cb1-4ebd-4b5d-a683-42545e0a1e99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:23.487493 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-96207cb1-4ebd-4b5d-a683-42545e0a1e99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:23.488639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-96207cb1-4ebd-4b5d-a683-42545e0a1e99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1721 microversion: 2.20 time: 0.151264 May 13 17:31:23.489205 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 410/802] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:23 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:23.833050 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-9cb1616c-579b-4ad4-b834-1bb91fc31f82 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:23.833584 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-9cb1616c-579b-4ad4-b834-1bb91fc31f82 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:23.840103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9cb1616c-579b-4ad4-b834-1bb91fc31f82 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:23.840560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9cb1616c-579b-4ad4-b834-1bb91fc31f82 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:23.841332 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9cb1616c-579b-4ad4-b834-1bb91fc31f82 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:23.841763 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9cb1616c-579b-4ad4-b834-1bb91fc31f82 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:23.967356 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-9cb1616c-579b-4ad4-b834-1bb91fc31f82 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:23.975380 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-9cb1616c-579b-4ad4-b834-1bb91fc31f82 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1724 microversion: 2.1 time: 0.146190 May 13 17:31:23.975953 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 393/803] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:23 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1724 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:24.070961 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-17ac4cdb-3b14-46cc-a8a5-8c749734a7ae tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:24.071598 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-17ac4cdb-3b14-46cc-a8a5-8c749734a7ae tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:24.077991 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-17ac4cdb-3b14-46cc-a8a5-8c749734a7ae tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:24.078447 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-17ac4cdb-3b14-46cc-a8a5-8c749734a7ae tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:24.079237 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-17ac4cdb-3b14-46cc-a8a5-8c749734a7ae tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:24.079679 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-17ac4cdb-3b14-46cc-a8a5-8c749734a7ae tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:24.210005 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-17ac4cdb-3b14-46cc-a8a5-8c749734a7ae tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:24.217981 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-17ac4cdb-3b14-46cc-a8a5-8c749734a7ae tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1372 microversion: 2.1 time: 0.150822 May 13 17:31:24.218545 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 411/804] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:24 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:24.505674 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-e40793e7-11d2-4cc5-aa5f-67cd5a2bff6c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:24.506209 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-e40793e7-11d2-4cc5-aa5f-67cd5a2bff6c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:24.512722 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e40793e7-11d2-4cc5-aa5f-67cd5a2bff6c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:24.513170 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e40793e7-11d2-4cc5-aa5f-67cd5a2bff6c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:24.513929 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e40793e7-11d2-4cc5-aa5f-67cd5a2bff6c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:24.514361 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e40793e7-11d2-4cc5-aa5f-67cd5a2bff6c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:24.639755 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-e40793e7-11d2-4cc5-aa5f-67cd5a2bff6c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:24.647401 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-e40793e7-11d2-4cc5-aa5f-67cd5a2bff6c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:24.648881 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-e40793e7-11d2-4cc5-aa5f-67cd5a2bff6c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:24.650025 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-e40793e7-11d2-4cc5-aa5f-67cd5a2bff6c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1721 microversion: 2.20 time: 0.148280 May 13 17:31:24.650584 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 394/805] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:24 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:24.992995 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2eea7375-00c0-4c38-9b55-09e68cb649b8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:24.993644 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2eea7375-00c0-4c38-9b55-09e68cb649b8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:24.999548 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2eea7375-00c0-4c38-9b55-09e68cb649b8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:24.999995 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2eea7375-00c0-4c38-9b55-09e68cb649b8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:25.000756 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2eea7375-00c0-4c38-9b55-09e68cb649b8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:25.001186 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2eea7375-00c0-4c38-9b55-09e68cb649b8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:25.135671 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2eea7375-00c0-4c38-9b55-09e68cb649b8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:25.143482 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2eea7375-00c0-4c38-9b55-09e68cb649b8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1724 microversion: 2.1 time: 0.154310 May 13 17:31:25.144043 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 412/806] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:24 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:25.235153 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-cf7954e3-05fc-4d8b-a641-d52e1ca82db8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:25.235881 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-cf7954e3-05fc-4d8b-a641-d52e1ca82db8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:25.242693 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cf7954e3-05fc-4d8b-a641-d52e1ca82db8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:25.243212 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cf7954e3-05fc-4d8b-a641-d52e1ca82db8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:25.243940 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cf7954e3-05fc-4d8b-a641-d52e1ca82db8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:25.244383 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cf7954e3-05fc-4d8b-a641-d52e1ca82db8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:25.373350 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-cf7954e3-05fc-4d8b-a641-d52e1ca82db8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:25.380592 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-cf7954e3-05fc-4d8b-a641-d52e1ca82db8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1372 microversion: 2.1 time: 0.149395 May 13 17:31:25.381388 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 395/807] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:25 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1372 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:25.669126 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-76a0b4f2-a854-47c6-89de-9bbe038757d7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:25.669731 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-76a0b4f2-a854-47c6-89de-9bbe038757d7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:25.675655 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-76a0b4f2-a854-47c6-89de-9bbe038757d7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:25.676092 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-76a0b4f2-a854-47c6-89de-9bbe038757d7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:25.676840 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-76a0b4f2-a854-47c6-89de-9bbe038757d7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:25.677378 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-76a0b4f2-a854-47c6-89de-9bbe038757d7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:25.808746 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-76a0b4f2-a854-47c6-89de-9bbe038757d7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:25.816488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-76a0b4f2-a854-47c6-89de-9bbe038757d7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:25.819374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-76a0b4f2-a854-47c6-89de-9bbe038757d7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:25.820549 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-76a0b4f2-a854-47c6-89de-9bbe038757d7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1721 microversion: 2.20 time: 0.155364 May 13 17:31:25.821963 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 413/808] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:25 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:31:26.161061 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-74e6d580-820f-4d79-a890-d1946a073a8d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:26.161667 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-74e6d580-820f-4d79-a890-d1946a073a8d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:26.168088 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-74e6d580-820f-4d79-a890-d1946a073a8d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:26.168538 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-74e6d580-820f-4d79-a890-d1946a073a8d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:26.169300 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-74e6d580-820f-4d79-a890-d1946a073a8d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:26.169733 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-74e6d580-820f-4d79-a890-d1946a073a8d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:26.293688 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-74e6d580-820f-4d79-a890-d1946a073a8d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:26.301419 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-74e6d580-820f-4d79-a890-d1946a073a8d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1701 microversion: 2.1 time: 0.144284 May 13 17:31:26.301991 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 396/809] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:26 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1701 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:26.317376 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-bc845b97-218c-4b2b-9390-d0ff03d26191 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:31:26.323636 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bc845b97-218c-4b2b-9390-d0ff03d26191 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:26.324090 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bc845b97-218c-4b2b-9390-d0ff03d26191 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:26.383964 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-bc845b97-218c-4b2b-9390-d0ff03d26191 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Going to try to start instance {{(pid=117493) start /opt/stack/nova/nova/compute/api.py:2730}} May 13 17:31:26.397660 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-bc51ee6c-e57a-4d28-bff8-1f14abb4776c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:26.398859 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-bc51ee6c-e57a-4d28-bff8-1f14abb4776c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:26.404655 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bc51ee6c-e57a-4d28-bff8-1f14abb4776c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:26.405115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bc51ee6c-e57a-4d28-bff8-1f14abb4776c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:26.405887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bc51ee6c-e57a-4d28-bff8-1f14abb4776c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:26.406362 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bc51ee6c-e57a-4d28-bff8-1f14abb4776c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:26.540365 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-bc51ee6c-e57a-4d28-bff8-1f14abb4776c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:26.547642 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-bc51ee6c-e57a-4d28-bff8-1f14abb4776c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1566 microversion: 2.1 time: 0.153868 May 13 17:31:26.548221 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 397/810] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:26 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:31:26.563472 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-714ef3b7-7b7a-45dd-91b2-8de0beebcbb7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:26.563959 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-714ef3b7-7b7a-45dd-91b2-8de0beebcbb7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:26.569842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-714ef3b7-7b7a-45dd-91b2-8de0beebcbb7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:26.570797 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-714ef3b7-7b7a-45dd-91b2-8de0beebcbb7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:26.571689 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-714ef3b7-7b7a-45dd-91b2-8de0beebcbb7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:26.572113 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-714ef3b7-7b7a-45dd-91b2-8de0beebcbb7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:26.579865 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-bc845b97-218c-4b2b-9390-d0ff03d26191 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "POST /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48/action" status: 202 len: 0 microversion: 2.1 time: 0.258271 May 13 17:31:26.579865 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 414/811] 10.222.0.64 () {60 vars in 1277 bytes} [Fri May 13 17:31:26 2022] POST /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:31:26.587657 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4d79d668-1eb1-4423-b897-803a4435a905 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:26.588359 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4d79d668-1eb1-4423-b897-803a4435a905 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:26.594521 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d79d668-1eb1-4423-b897-803a4435a905 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:26.594976 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d79d668-1eb1-4423-b897-803a4435a905 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:26.595789 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d79d668-1eb1-4423-b897-803a4435a905 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:26.596232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d79d668-1eb1-4423-b897-803a4435a905 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:26.648300 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-714ef3b7-7b7a-45dd-91b2-8de0beebcbb7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088338 May 13 17:31:26.648905 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 398/812] 10.222.0.64 () {58 vars in 1274 bytes} [Fri May 13 17:31:26 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:31:26.732476 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4d79d668-1eb1-4423-b897-803a4435a905 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:26.740282 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4d79d668-1eb1-4423-b897-803a4435a905 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1710 microversion: 2.1 time: 0.157385 May 13 17:31:26.740857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 415/813] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:26 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1710 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:31:26.840091 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-4b794e99-aa54-4a18-aeff-7cca079d29c4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:26.840744 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-4b794e99-aa54-4a18-aeff-7cca079d29c4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:26.846765 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4b794e99-aa54-4a18-aeff-7cca079d29c4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:26.847586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4b794e99-aa54-4a18-aeff-7cca079d29c4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:26.848356 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4b794e99-aa54-4a18-aeff-7cca079d29c4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:26.848796 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4b794e99-aa54-4a18-aeff-7cca079d29c4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:27.271344 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-4b794e99-aa54-4a18-aeff-7cca079d29c4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:27.279083 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-4b794e99-aa54-4a18-aeff-7cca079d29c4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:27.280607 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-4b794e99-aa54-4a18-aeff-7cca079d29c4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:27.281761 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-4b794e99-aa54-4a18-aeff-7cca079d29c4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1721 microversion: 2.20 time: 0.445685 May 13 17:31:27.282315 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 399/814] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:26 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1721 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:27.757561 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-87ee0b22-4e97-4701-8dfe-e1d730a52f5f tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:27.758230 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-87ee0b22-4e97-4701-8dfe-e1d730a52f5f tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:27.764435 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-87ee0b22-4e97-4701-8dfe-e1d730a52f5f tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:27.764890 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-87ee0b22-4e97-4701-8dfe-e1d730a52f5f tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:27.765658 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-87ee0b22-4e97-4701-8dfe-e1d730a52f5f tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:27.766098 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-87ee0b22-4e97-4701-8dfe-e1d730a52f5f tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:27.892655 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-87ee0b22-4e97-4701-8dfe-e1d730a52f5f tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:27.900953 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-87ee0b22-4e97-4701-8dfe-e1d730a52f5f tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1710 microversion: 2.1 time: 0.147086 May 13 17:31:27.901703 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 416/815] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:27 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1710 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:27.952795 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-e2534814-1ef8-4659-8bca-63a71282cd24 req-fc9aec0a-ce92-4d7d-8240-651a08e55521 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe4a882-7b2b-4cfb-99f2-b722277d132c", "tag": "d05de053-6bc4-4262-992c-723e87e69ddf"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:31:27.960903 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-e2534814-1ef8-4659-8bca-63a71282cd24 req-fc9aec0a-ce92-4d7d-8240-651a08e55521 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:27.961349 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-e2534814-1ef8-4659-8bca-63a71282cd24 req-fc9aec0a-ce92-4d7d-8240-651a08e55521 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:27.972797 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-e2534814-1ef8-4659-8bca-63a71282cd24 req-fc9aec0a-ce92-4d7d-8240-651a08e55521 service nova] Creating event network-changed:d05de053-6bc4-4262-992c-723e87e69ddf for instance afe4a882-7b2b-4cfb-99f2-b722277d132c on hv-cinder-84178 May 13 17:31:27.978239 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-e2534814-1ef8-4659-8bca-63a71282cd24 req-fc9aec0a-ce92-4d7d-8240-651a08e55521 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029058 May 13 17:31:27.979020 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 400/816] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:31:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:31:28.300411 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b66701c5-a2fe-4c9a-a09c-2a8bb16d1db1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:28.301024 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b66701c5-a2fe-4c9a-a09c-2a8bb16d1db1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:28.307345 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b66701c5-a2fe-4c9a-a09c-2a8bb16d1db1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:28.307795 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b66701c5-a2fe-4c9a-a09c-2a8bb16d1db1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:28.308564 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b66701c5-a2fe-4c9a-a09c-2a8bb16d1db1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:28.308999 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b66701c5-a2fe-4c9a-a09c-2a8bb16d1db1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:28.453392 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b66701c5-a2fe-4c9a-a09c-2a8bb16d1db1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:28.463685 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b66701c5-a2fe-4c9a-a09c-2a8bb16d1db1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:28.465198 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b66701c5-a2fe-4c9a-a09c-2a8bb16d1db1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:28.468009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b66701c5-a2fe-4c9a-a09c-2a8bb16d1db1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1721 microversion: 2.20 time: 0.169812 May 13 17:31:28.468009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 417/817] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:28 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1721 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:28.920268 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6aca8de0-1d5f-493f-9c21-db000daa15b2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:28.920962 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6aca8de0-1d5f-493f-9c21-db000daa15b2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:28.927109 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6aca8de0-1d5f-493f-9c21-db000daa15b2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:28.927590 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6aca8de0-1d5f-493f-9c21-db000daa15b2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:28.928359 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6aca8de0-1d5f-493f-9c21-db000daa15b2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:28.928799 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6aca8de0-1d5f-493f-9c21-db000daa15b2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:29.057237 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6aca8de0-1d5f-493f-9c21-db000daa15b2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:29.065169 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6aca8de0-1d5f-493f-9c21-db000daa15b2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1710 microversion: 2.1 time: 0.150721 May 13 17:31:29.065740 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 401/818] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:28 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1710 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:29.486063 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c8420caa-e638-4b80-898d-9adbe499471c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:29.486662 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c8420caa-e638-4b80-898d-9adbe499471c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:29.493581 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c8420caa-e638-4b80-898d-9adbe499471c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:29.494026 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c8420caa-e638-4b80-898d-9adbe499471c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:29.494790 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c8420caa-e638-4b80-898d-9adbe499471c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:29.495246 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c8420caa-e638-4b80-898d-9adbe499471c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:29.623009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c8420caa-e638-4b80-898d-9adbe499471c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:29.630687 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c8420caa-e638-4b80-898d-9adbe499471c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:29.632260 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c8420caa-e638-4b80-898d-9adbe499471c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:29.633411 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c8420caa-e638-4b80-898d-9adbe499471c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1721 microversion: 2.20 time: 0.151191 May 13 17:31:29.633976 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 418/819] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:29 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:30.082845 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-2119132f-683c-45e7-938e-50b3a08d5f4d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:30.083422 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-2119132f-683c-45e7-938e-50b3a08d5f4d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:30.089589 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2119132f-683c-45e7-938e-50b3a08d5f4d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:30.090039 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2119132f-683c-45e7-938e-50b3a08d5f4d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:30.090805 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2119132f-683c-45e7-938e-50b3a08d5f4d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:30.091270 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2119132f-683c-45e7-938e-50b3a08d5f4d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:30.226070 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-2119132f-683c-45e7-938e-50b3a08d5f4d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:30.234464 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-2119132f-683c-45e7-938e-50b3a08d5f4d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1710 microversion: 2.1 time: 0.155718 May 13 17:31:30.235030 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 402/820] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:30 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1710 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:30.652127 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4ecad242-e599-44e8-9ec7-844bd59efd3c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:30.652743 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4ecad242-e599-44e8-9ec7-844bd59efd3c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:30.658950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4ecad242-e599-44e8-9ec7-844bd59efd3c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:30.659436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4ecad242-e599-44e8-9ec7-844bd59efd3c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:30.660200 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4ecad242-e599-44e8-9ec7-844bd59efd3c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:30.660641 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4ecad242-e599-44e8-9ec7-844bd59efd3c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:30.786436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4ecad242-e599-44e8-9ec7-844bd59efd3c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:30.794694 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4ecad242-e599-44e8-9ec7-844bd59efd3c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:30.796290 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4ecad242-e599-44e8-9ec7-844bd59efd3c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:30.797530 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4ecad242-e599-44e8-9ec7-844bd59efd3c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1721 microversion: 2.20 time: 0.149915 May 13 17:31:30.798090 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 419/821] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:30 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:31.251499 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-9b1af017-4c23-44fe-8dcd-6069a56fbb54 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:31.252134 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-9b1af017-4c23-44fe-8dcd-6069a56fbb54 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:31.259004 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9b1af017-4c23-44fe-8dcd-6069a56fbb54 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:31.259479 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9b1af017-4c23-44fe-8dcd-6069a56fbb54 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:31.260247 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9b1af017-4c23-44fe-8dcd-6069a56fbb54 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:31.260689 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9b1af017-4c23-44fe-8dcd-6069a56fbb54 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:31.395593 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-9b1af017-4c23-44fe-8dcd-6069a56fbb54 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:31.411594 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-9b1af017-4c23-44fe-8dcd-6069a56fbb54 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1710 microversion: 2.1 time: 0.163846 May 13 17:31:31.412388 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 403/822] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:31 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1710 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:31.816791 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-65b039f9-2555-4d39-9755-404f7a518a45 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:31.817680 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-65b039f9-2555-4d39-9755-404f7a518a45 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:31.824461 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-65b039f9-2555-4d39-9755-404f7a518a45 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:31.829054 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-65b039f9-2555-4d39-9755-404f7a518a45 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:31.829054 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-65b039f9-2555-4d39-9755-404f7a518a45 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:31.829054 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-65b039f9-2555-4d39-9755-404f7a518a45 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:32.059560 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-65b039f9-2555-4d39-9755-404f7a518a45 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:32.067488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-65b039f9-2555-4d39-9755-404f7a518a45 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:32.068922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-65b039f9-2555-4d39-9755-404f7a518a45 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:32.070073 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-65b039f9-2555-4d39-9755-404f7a518a45 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1721 microversion: 2.20 time: 0.257574 May 13 17:31:32.070654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 420/823] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:31 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1721 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:32.428781 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-81a18a92-c057-47a0-bc95-087d4fa69230 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:32.430449 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-81a18a92-c057-47a0-bc95-087d4fa69230 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:32.436924 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-81a18a92-c057-47a0-bc95-087d4fa69230 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:32.437441 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-81a18a92-c057-47a0-bc95-087d4fa69230 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:32.438251 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-81a18a92-c057-47a0-bc95-087d4fa69230 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:32.438703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-81a18a92-c057-47a0-bc95-087d4fa69230 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:32.565314 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-81a18a92-c057-47a0-bc95-087d4fa69230 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:32.573406 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-81a18a92-c057-47a0-bc95-087d4fa69230 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1710 microversion: 2.1 time: 0.148616 May 13 17:31:32.573974 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 404/824] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:32 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1710 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:33.088715 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-97152612-1a1c-477a-a04e-e6e3272ccf3e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:33.089323 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-97152612-1a1c-477a-a04e-e6e3272ccf3e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:33.095549 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-97152612-1a1c-477a-a04e-e6e3272ccf3e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:33.096001 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-97152612-1a1c-477a-a04e-e6e3272ccf3e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:33.096853 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-97152612-1a1c-477a-a04e-e6e3272ccf3e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:33.097550 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-97152612-1a1c-477a-a04e-e6e3272ccf3e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:33.231140 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-97152612-1a1c-477a-a04e-e6e3272ccf3e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:33.238884 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-97152612-1a1c-477a-a04e-e6e3272ccf3e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:33.240471 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-97152612-1a1c-477a-a04e-e6e3272ccf3e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:33.241628 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-97152612-1a1c-477a-a04e-e6e3272ccf3e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1721 microversion: 2.20 time: 0.157449 May 13 17:31:33.242190 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 421/825] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:33 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:33.590510 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-240ac986-da06-4045-b1aa-0bdf37486235 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:33.591151 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-240ac986-da06-4045-b1aa-0bdf37486235 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:33.597759 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-240ac986-da06-4045-b1aa-0bdf37486235 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:33.598211 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-240ac986-da06-4045-b1aa-0bdf37486235 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:33.599042 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-240ac986-da06-4045-b1aa-0bdf37486235 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:33.599511 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-240ac986-da06-4045-b1aa-0bdf37486235 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:33.728161 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-240ac986-da06-4045-b1aa-0bdf37486235 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:33.736202 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-240ac986-da06-4045-b1aa-0bdf37486235 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1710 microversion: 2.1 time: 0.149606 May 13 17:31:33.736775 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 405/826] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:33 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1710 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:34.264776 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4316513f-fe56-4634-950e-3f2cafbf4cf2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:34.264776 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4316513f-fe56-4634-950e-3f2cafbf4cf2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:34.269875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4316513f-fe56-4634-950e-3f2cafbf4cf2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:34.270332 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4316513f-fe56-4634-950e-3f2cafbf4cf2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:34.271100 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4316513f-fe56-4634-950e-3f2cafbf4cf2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:34.271571 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4316513f-fe56-4634-950e-3f2cafbf4cf2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:34.399525 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4316513f-fe56-4634-950e-3f2cafbf4cf2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:34.407502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4316513f-fe56-4634-950e-3f2cafbf4cf2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:34.409101 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4316513f-fe56-4634-950e-3f2cafbf4cf2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:34.410268 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4316513f-fe56-4634-950e-3f2cafbf4cf2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1721 microversion: 2.20 time: 0.151055 May 13 17:31:34.410833 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 422/827] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:34 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:34.754263 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-88c3e29c-5eb8-4263-94b4-6e0e3fb90dda tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:34.754664 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-88c3e29c-5eb8-4263-94b4-6e0e3fb90dda tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:34.761504 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-88c3e29c-5eb8-4263-94b4-6e0e3fb90dda tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:34.761950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-88c3e29c-5eb8-4263-94b4-6e0e3fb90dda tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:34.762905 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-88c3e29c-5eb8-4263-94b4-6e0e3fb90dda tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:34.763156 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-88c3e29c-5eb8-4263-94b4-6e0e3fb90dda tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:34.889873 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-88c3e29c-5eb8-4263-94b4-6e0e3fb90dda tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:34.898246 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-88c3e29c-5eb8-4263-94b4-6e0e3fb90dda tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1710 microversion: 2.1 time: 0.148337 May 13 17:31:34.899064 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 406/828] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:34 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1710 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:35.372928 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-86a355be-b867-4041-b105-0d428263025a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:35.373445 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-86a355be-b867-4041-b105-0d428263025a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:35.379591 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-86a355be-b867-4041-b105-0d428263025a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:35.380041 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-86a355be-b867-4041-b105-0d428263025a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:35.380803 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-86a355be-b867-4041-b105-0d428263025a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:35.381237 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-86a355be-b867-4041-b105-0d428263025a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:35.428325 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f9cf1cb4-2fe0-4fb6-8559-7279de6bc40e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:35.428935 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-f9cf1cb4-2fe0-4fb6-8559-7279de6bc40e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:35.435719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f9cf1cb4-2fe0-4fb6-8559-7279de6bc40e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:35.436168 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f9cf1cb4-2fe0-4fb6-8559-7279de6bc40e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:35.436942 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f9cf1cb4-2fe0-4fb6-8559-7279de6bc40e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:35.437410 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f9cf1cb4-2fe0-4fb6-8559-7279de6bc40e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:35.520108 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-86a355be-b867-4041-b105-0d428263025a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lazy-loading 'services' on Instance uuid 8f03ec8a-33aa-483a-af99-ff3925f006a1 {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:31:35.578156 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f9cf1cb4-2fe0-4fb6-8559-7279de6bc40e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:35.585922 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f9cf1cb4-2fe0-4fb6-8559-7279de6bc40e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:35.587943 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f9cf1cb4-2fe0-4fb6-8559-7279de6bc40e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:35.588652 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f9cf1cb4-2fe0-4fb6-8559-7279de6bc40e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1724 microversion: 2.20 time: 0.164216 May 13 17:31:35.589385 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 407/829] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:35 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:31:35.607529 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-977005f9-0a6e-414f-99df-0ec017504cb3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "acf0d035-7b3f-4b46-84b3-cb637bbb866d"}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:31:35.608547 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-977005f9-0a6e-414f-99df-0ec017504cb3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:35.615402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-977005f9-0a6e-414f-99df-0ec017504cb3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:35.618733 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-977005f9-0a6e-414f-99df-0ec017504cb3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:35.618733 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-977005f9-0a6e-414f-99df-0ec017504cb3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:35.618733 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-977005f9-0a6e-414f-99df-0ec017504cb3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:35.824678 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-86a355be-b867-4041-b105-0d428263025a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "DELETE /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1/os-volume_attachments/44a5c87b-ffcf-4de6-b87d-a9e4d0fa6fd9" status: 202 len: 0 microversion: 2.1 time: 0.455381 May 13 17:31:35.825340 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 423/830] 10.222.0.64 () {58 vars in 1415 bytes} [Fri May 13 17:31:35 2022] DELETE /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1/os-volume_attachments/44a5c87b-ffcf-4de6-b87d-a9e4d0fa6fd9 => generated 0 bytes in 457 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:31:35.915471 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-bc3f0e51-0d3c-4d6c-8492-5ae95e6e99a2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:35.916172 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-bc3f0e51-0d3c-4d6c-8492-5ae95e6e99a2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:35.922209 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bc3f0e51-0d3c-4d6c-8492-5ae95e6e99a2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:35.922660 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bc3f0e51-0d3c-4d6c-8492-5ae95e6e99a2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:35.923468 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bc3f0e51-0d3c-4d6c-8492-5ae95e6e99a2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:35.923901 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-bc3f0e51-0d3c-4d6c-8492-5ae95e6e99a2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:36.051955 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-bc3f0e51-0d3c-4d6c-8492-5ae95e6e99a2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:36.059680 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-bc3f0e51-0d3c-4d6c-8492-5ae95e6e99a2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1714 microversion: 2.1 time: 0.148597 May 13 17:31:36.060250 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 424/831] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:35 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1714 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:31:36.646991 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-977005f9-0a6e-414f-99df-0ec017504cb3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "POST /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.043578 May 13 17:31:36.647675 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 408/832] 10.222.0.64 () {62 vars in 1363 bytes} [Fri May 13 17:31:35 2022] POST /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67/os-volume_attachments => generated 188 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 17:31:36.756682 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8e26aabb-a712-47af-8625-b507c49c428e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:31:36.757253 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8e26aabb-a712-47af-8625-b507c49c428e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:36.764016 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8e26aabb-a712-47af-8625-b507c49c428e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:36.764475 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8e26aabb-a712-47af-8625-b507c49c428e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:36.765335 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8e26aabb-a712-47af-8625-b507c49c428e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:36.765778 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8e26aabb-a712-47af-8625-b507c49c428e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:37.016315 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8e26aabb-a712-47af-8625-b507c49c428e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "POST /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67/action" status: 202 len: 0 microversion: 2.20 time: 0.263396 May 13 17:31:37.017050 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 425/833] 10.222.0.64 () {62 vars in 1318 bytes} [Fri May 13 17:31:36 2022] POST /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67/action => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 17:31:37.025143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b24b6e59-d56d-40fb-ac5a-e90ea5f2400c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:37.025841 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b24b6e59-d56d-40fb-ac5a-e90ea5f2400c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:37.033307 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b24b6e59-d56d-40fb-ac5a-e90ea5f2400c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:37.033939 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b24b6e59-d56d-40fb-ac5a-e90ea5f2400c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:37.034690 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b24b6e59-d56d-40fb-ac5a-e90ea5f2400c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:37.035148 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b24b6e59-d56d-40fb-ac5a-e90ea5f2400c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:37.169315 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b24b6e59-d56d-40fb-ac5a-e90ea5f2400c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:37.177568 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b24b6e59-d56d-40fb-ac5a-e90ea5f2400c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:37.179095 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b24b6e59-d56d-40fb-ac5a-e90ea5f2400c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:37.181037 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b24b6e59-d56d-40fb-ac5a-e90ea5f2400c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1750 microversion: 2.20 time: 0.159729 May 13 17:31:37.194782 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 409/834] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:37 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1750 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:37.993832 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-cd77e791-f2fe-41c2-93ca-a5c0bf3049ec tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:37.994316 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-cd77e791-f2fe-41c2-93ca-a5c0bf3049ec tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:38.000339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cd77e791-f2fe-41c2-93ca-a5c0bf3049ec tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:38.000793 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cd77e791-f2fe-41c2-93ca-a5c0bf3049ec tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:38.001564 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cd77e791-f2fe-41c2-93ca-a5c0bf3049ec tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:38.002003 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cd77e791-f2fe-41c2-93ca-a5c0bf3049ec tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:38.026357 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-cd77e791-f2fe-41c2-93ca-a5c0bf3049ec tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Going to try to terminate instance {{(pid=117493) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 17:31:38.213845 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-aa07ae9b-9f07-4c1c-8687-06c2af3ac0f9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:38.214452 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-aa07ae9b-9f07-4c1c-8687-06c2af3ac0f9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:38.221137 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-aa07ae9b-9f07-4c1c-8687-06c2af3ac0f9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:38.221581 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-aa07ae9b-9f07-4c1c-8687-06c2af3ac0f9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:38.222801 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-aa07ae9b-9f07-4c1c-8687-06c2af3ac0f9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:38.223279 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-aa07ae9b-9f07-4c1c-8687-06c2af3ac0f9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:38.328153 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-cd77e791-f2fe-41c2-93ca-a5c0bf3049ec tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "DELETE /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 204 len: 0 microversion: 2.1 time: 0.338379 May 13 17:31:38.332186 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 426/835] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:31:37 2022] DELETE /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 17:31:38.338394 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-76c553d4-dde5-4883-a803-5ec5911fb31d tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:38.339092 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-76c553d4-dde5-4883-a803-5ec5911fb31d tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:38.345443 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-76c553d4-dde5-4883-a803-5ec5911fb31d tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:38.346102 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-76c553d4-dde5-4883-a803-5ec5911fb31d tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:38.346914 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-76c553d4-dde5-4883-a803-5ec5911fb31d tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:38.347676 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-76c553d4-dde5-4883-a803-5ec5911fb31d tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:38.361243 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-aa07ae9b-9f07-4c1c-8687-06c2af3ac0f9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:38.370899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-aa07ae9b-9f07-4c1c-8687-06c2af3ac0f9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:38.372430 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-aa07ae9b-9f07-4c1c-8687-06c2af3ac0f9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:38.373787 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-aa07ae9b-9f07-4c1c-8687-06c2af3ac0f9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1750 microversion: 2.20 time: 0.164346 May 13 17:31:38.374538 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 410/836] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:38 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:31:38.480323 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-76c553d4-dde5-4883-a803-5ec5911fb31d tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:38.487713 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-76c553d4-dde5-4883-a803-5ec5911fb31d tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 200 len: 1514 microversion: 2.1 time: 0.154023 May 13 17:31:38.490679 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 427/837] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:38 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 1514 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:39.392306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3404afad-70b2-4957-827c-3fdf40f5911b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:39.392912 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3404afad-70b2-4957-827c-3fdf40f5911b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:39.399244 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3404afad-70b2-4957-827c-3fdf40f5911b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:39.399695 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3404afad-70b2-4957-827c-3fdf40f5911b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:39.400459 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3404afad-70b2-4957-827c-3fdf40f5911b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:39.400899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3404afad-70b2-4957-827c-3fdf40f5911b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:39.505358 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-cdefaa82-ffe1-41c2-987d-65c5b991dddf tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:39.506081 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-cdefaa82-ffe1-41c2-987d-65c5b991dddf tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:39.512333 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cdefaa82-ffe1-41c2-987d-65c5b991dddf tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:39.512788 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cdefaa82-ffe1-41c2-987d-65c5b991dddf tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:39.513567 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cdefaa82-ffe1-41c2-987d-65c5b991dddf tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:39.514011 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cdefaa82-ffe1-41c2-987d-65c5b991dddf tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:39.527856 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3404afad-70b2-4957-827c-3fdf40f5911b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:39.536462 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3404afad-70b2-4957-827c-3fdf40f5911b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:39.537963 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3404afad-70b2-4957-827c-3fdf40f5911b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:39.539749 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3404afad-70b2-4957-827c-3fdf40f5911b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1750 microversion: 2.20 time: 0.151306 May 13 17:31:39.540316 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 411/838] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:39 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1750 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:39.643489 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-cdefaa82-ffe1-41c2-987d-65c5b991dddf tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:39.650649 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-cdefaa82-ffe1-41c2-987d-65c5b991dddf tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 200 len: 1514 microversion: 2.1 time: 0.149112 May 13 17:31:39.651257 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 428/839] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:39 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 1514 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:31:40.557826 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-817c4571-4b60-4582-b1b5-f5bdccc3bc3a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:40.558441 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-817c4571-4b60-4582-b1b5-f5bdccc3bc3a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:40.564916 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-817c4571-4b60-4582-b1b5-f5bdccc3bc3a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:40.565371 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-817c4571-4b60-4582-b1b5-f5bdccc3bc3a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:40.566148 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-817c4571-4b60-4582-b1b5-f5bdccc3bc3a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:40.566589 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-817c4571-4b60-4582-b1b5-f5bdccc3bc3a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:40.668923 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e5a9894b-a13e-4924-8381-ac02dffb7990 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:40.670855 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e5a9894b-a13e-4924-8381-ac02dffb7990 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:40.680451 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e5a9894b-a13e-4924-8381-ac02dffb7990 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:40.680913 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e5a9894b-a13e-4924-8381-ac02dffb7990 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:40.681708 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e5a9894b-a13e-4924-8381-ac02dffb7990 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:40.684422 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e5a9894b-a13e-4924-8381-ac02dffb7990 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:40.764853 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-817c4571-4b60-4582-b1b5-f5bdccc3bc3a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:40.775494 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-817c4571-4b60-4582-b1b5-f5bdccc3bc3a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:40.777165 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-817c4571-4b60-4582-b1b5-f5bdccc3bc3a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:40.778248 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-817c4571-4b60-4582-b1b5-f5bdccc3bc3a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1752 microversion: 2.20 time: 0.224411 May 13 17:31:40.778812 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 412/840] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:40 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1752 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:40.960555 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e5a9894b-a13e-4924-8381-ac02dffb7990 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:40.967908 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e5a9894b-a13e-4924-8381-ac02dffb7990 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 200 len: 1514 microversion: 2.1 time: 0.303966 May 13 17:31:40.968773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 429/841] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:40 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 1514 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:31:41.332398 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-536ecf11-f092-4646-84a1-f92cb795b8df req-0539101d-c216-482f-8ae3-d7c01018f9ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f03ec8a-33aa-483a-af99-ff3925f006a1", "name": "network-vif-deleted", "tag": "551049b3-f6c2-479f-9493-4761a2f86f8e"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:31:41.340249 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-536ecf11-f092-4646-84a1-f92cb795b8df req-0539101d-c216-482f-8ae3-d7c01018f9ff service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:41.344002 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-536ecf11-f092-4646-84a1-f92cb795b8df req-0539101d-c216-482f-8ae3-d7c01018f9ff service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:41.351841 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-536ecf11-f092-4646-84a1-f92cb795b8df req-0539101d-c216-482f-8ae3-d7c01018f9ff service nova] Creating event network-vif-deleted:551049b3-f6c2-479f-9493-4761a2f86f8e for instance 8f03ec8a-33aa-483a-af99-ff3925f006a1 on hv-cinder-84178 May 13 17:31:41.356773 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-536ecf11-f092-4646-84a1-f92cb795b8df req-0539101d-c216-482f-8ae3-d7c01018f9ff service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027972 May 13 17:31:41.357361 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 413/842] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:31:41.795987 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e2f156fb-f187-4f11-b809-c98d5ccbfc12 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:41.796588 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e2f156fb-f187-4f11-b809-c98d5ccbfc12 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:41.802798 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e2f156fb-f187-4f11-b809-c98d5ccbfc12 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:41.803278 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e2f156fb-f187-4f11-b809-c98d5ccbfc12 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:41.804043 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e2f156fb-f187-4f11-b809-c98d5ccbfc12 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:41.804507 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e2f156fb-f187-4f11-b809-c98d5ccbfc12 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:41.985860 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e2f156fb-f187-4f11-b809-c98d5ccbfc12 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:41.986782 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-c3716088-635a-4bd6-973b-4f429e21d919 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:41.987586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-c3716088-635a-4bd6-973b-4f429e21d919 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:41.993701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c3716088-635a-4bd6-973b-4f429e21d919 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:41.994250 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c3716088-635a-4bd6-973b-4f429e21d919 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:41.994826 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e2f156fb-f187-4f11-b809-c98d5ccbfc12 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:41.995210 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c3716088-635a-4bd6-973b-4f429e21d919 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:41.995702 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c3716088-635a-4bd6-973b-4f429e21d919 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:41.996401 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e2f156fb-f187-4f11-b809-c98d5ccbfc12 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:41.997718 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e2f156fb-f187-4f11-b809-c98d5ccbfc12 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1752 microversion: 2.20 time: 0.205707 May 13 17:31:41.998652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 430/843] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:41 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1752 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:42.027373 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c3716088-635a-4bd6-973b-4f429e21d919 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:42.027815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c3716088-635a-4bd6-973b-4f429e21d919 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:42.028256 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.objects.instance [None req-c3716088-635a-4bd6-973b-4f429e21d919 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lazy-loading 'fault' on Instance uuid 8f03ec8a-33aa-483a-af99-ff3925f006a1 {{(pid=117492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:31:42.067474 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c3716088-635a-4bd6-973b-4f429e21d919 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:42.075352 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-c3716088-635a-4bd6-973b-4f429e21d919 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 200 len: 1309 microversion: 2.1 time: 0.093387 May 13 17:31:42.075939 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 414/844] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:41 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:31:43.016274 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e8ffe257-d8b6-4ca5-bb4c-1748b260415d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:43.016878 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e8ffe257-d8b6-4ca5-bb4c-1748b260415d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:43.024005 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e8ffe257-d8b6-4ca5-bb4c-1748b260415d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:43.024448 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e8ffe257-d8b6-4ca5-bb4c-1748b260415d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:43.025209 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e8ffe257-d8b6-4ca5-bb4c-1748b260415d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:43.025644 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e8ffe257-d8b6-4ca5-bb4c-1748b260415d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:43.097953 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-62875c93-e20f-41e5-9c49-e0880533422a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:43.098679 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-62875c93-e20f-41e5-9c49-e0880533422a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 8f03ec8a-33aa-483a-af99-ff3925f006a1] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:43.105746 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-62875c93-e20f-41e5-9c49-e0880533422a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:43.106204 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-62875c93-e20f-41e5-9c49-e0880533422a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:43.106980 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-62875c93-e20f-41e5-9c49-e0880533422a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:43.107457 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-62875c93-e20f-41e5-9c49-e0880533422a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:43.120598 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-62875c93-e20f-41e5-9c49-e0880533422a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] HTTP exception thrown: Instance 8f03ec8a-33aa-483a-af99-ff3925f006a1 could not be found. May 13 17:31:43.122240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-62875c93-e20f-41e5-9c49-e0880533422a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Request method failure captured: May 13 17:31:43.122240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 HTTP/1.1 May 13 17:31:43.122240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:31:43.122240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:31:43.122240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:31:43.122240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 0 May 13 17:31:43.122240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:31:43.122240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:31:43.122240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:31:43.122240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:31:43.122240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpWOudamhPa3Any_QypZf3CnsKfBmZey3zDDDHOS16cHaD9EMBA78ECV0h0Vf0dmb5PYxYkNz4r3mnuQexmMegY7Io4KOlQnq1ltHsGnVtnhGMH69qRyESinSpHVHubSVaO-TNYhyfYazJxy5V17cLs7bf3w1uGUZzV-l6F31VHZmd0 May 13 17:31:43.122240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:31:43.122240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:31:43.122240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:31:43.122240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:31:43.122240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:31:43.122240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:31:43.122240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: e9f5f08db8cb40f0857115f4c9aadaf7 May 13 17:31:43.122240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-VolumesSnapshotTestJSON-25963212 May 13 17:31:43.122240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:31:43.122240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:31:43.123625 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e9f5f08db8cb40f0857115f4c9aadaf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e9f5f08db8cb40f0857115f4c9aadaf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e9f5f08db8cb40f0857115f4c9aadaf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e9f5f08db8cb40f0857115f4c9aadaf7"}]}] May 13 17:31:43.123625 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-VolumesSnapshotTestJSON-25963212 May 13 17:31:43.123625 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: e9f5f08db8cb40f0857115f4c9aadaf7 May 13 17:31:43.123625 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-25963212 May 13 17:31:43.123625 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-VolumesSnapshotTestJSON-25963212-project May 13 17:31:43.123625 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:31:43.123625 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:31:43.123625 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: 00983ee7706f43d4b3f7d0f178c0e924 May 13 17:31:43.123625 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-VolumesSnapshotTestJSON-25963212-project May 13 17:31:43.123625 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: > May 13 17:31:43.123625 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Instance 8f03ec8a-33aa-483a-af99-ff3925f006a1 could not be found. May 13 17:31:43.123625 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'id': '8f03ec8a-33aa-483a-af99-ff3925f006a1'} May 13 17:31:43.124408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:31:43.124408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:31:43.124408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:31:43.124408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:31:43.124408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:31:43.124408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:31:43.124408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:31:43.124408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:31:43.124408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:31:43.124408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:31:43.124408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f03ec8a-33aa-483a-af99-ff3925f006a1 could not be found. May 13 17:31:43.124408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:31:43.124408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:31:43.124408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:31:43.124408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:31:43.124408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:31:43.124408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:31:43.124408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:31:43.124408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:31:43.124408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:31:43.125644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:31:43.125644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:31:43.125644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:31:43.125644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:31:43.125644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:31:43.125644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:31:43.125644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:31:43.125644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f03ec8a-33aa-483a-af99-ff3925f006a1 could not be found. May 13 17:31:43.125644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:31:43.125644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:31:43.125644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:31:43.125644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:31:43.125644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:31:43.125644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:31:43.125644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:31:43.125644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:31:43.125644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f03ec8a-33aa-483a-af99-ff3925f006a1 could not be found. May 13 17:31:43.125644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:31:43.126768 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-62875c93-e20f-41e5-9c49-e0880533422a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Returning 404 to user: Instance 8f03ec8a-33aa-483a-af99-ff3925f006a1 could not be found. {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:31:43.126768 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-62875c93-e20f-41e5-9c49-e0880533422a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1" status: 404 len: 111 microversion: 2.1 time: 0.029828 May 13 17:31:43.126768 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 415/845] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:43 2022] GET /compute/v2.1/servers/8f03ec8a-33aa-483a-af99-ff3925f006a1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 17:31:43.155646 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e8ffe257-d8b6-4ca5-bb4c-1748b260415d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:43.164427 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e8ffe257-d8b6-4ca5-bb4c-1748b260415d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:43.165933 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e8ffe257-d8b6-4ca5-bb4c-1748b260415d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:43.167145 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e8ffe257-d8b6-4ca5-bb4c-1748b260415d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.154654 May 13 17:31:43.167700 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 431/846] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:43 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:44.185638 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-eb2c7dfe-6d9a-42b4-9449-fbbc02a3a1b8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:44.186176 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-eb2c7dfe-6d9a-42b4-9449-fbbc02a3a1b8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:44.192525 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-eb2c7dfe-6d9a-42b4-9449-fbbc02a3a1b8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:44.192976 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-eb2c7dfe-6d9a-42b4-9449-fbbc02a3a1b8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:44.193753 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-eb2c7dfe-6d9a-42b4-9449-fbbc02a3a1b8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:44.194191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-eb2c7dfe-6d9a-42b4-9449-fbbc02a3a1b8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:44.318449 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-eb2c7dfe-6d9a-42b4-9449-fbbc02a3a1b8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:44.327189 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-eb2c7dfe-6d9a-42b4-9449-fbbc02a3a1b8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:44.328687 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-eb2c7dfe-6d9a-42b4-9449-fbbc02a3a1b8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:44.329843 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-eb2c7dfe-6d9a-42b4-9449-fbbc02a3a1b8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.148248 May 13 17:31:44.330419 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 416/847] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:44 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:45.348875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-361ff872-fd3a-4822-b07b-aae6e89bf7e5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:45.349409 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-361ff872-fd3a-4822-b07b-aae6e89bf7e5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:45.355700 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-361ff872-fd3a-4822-b07b-aae6e89bf7e5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:45.357722 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-361ff872-fd3a-4822-b07b-aae6e89bf7e5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:45.357722 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-361ff872-fd3a-4822-b07b-aae6e89bf7e5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:45.357722 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-361ff872-fd3a-4822-b07b-aae6e89bf7e5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:45.480614 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 17:31:45.481125 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Fri May 13 17:31:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 17:31:45.527029 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-361ff872-fd3a-4822-b07b-aae6e89bf7e5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:45.535363 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-361ff872-fd3a-4822-b07b-aae6e89bf7e5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:45.536872 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-361ff872-fd3a-4822-b07b-aae6e89bf7e5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:45.538138 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-361ff872-fd3a-4822-b07b-aae6e89bf7e5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.193422 May 13 17:31:45.539376 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 432/848] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:45 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:46.556560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a4d773f6-3b2c-48be-9937-edc4426cb3e7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:46.557174 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a4d773f6-3b2c-48be-9937-edc4426cb3e7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:46.563547 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a4d773f6-3b2c-48be-9937-edc4426cb3e7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:46.563992 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a4d773f6-3b2c-48be-9937-edc4426cb3e7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:46.564760 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a4d773f6-3b2c-48be-9937-edc4426cb3e7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:46.565196 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a4d773f6-3b2c-48be-9937-edc4426cb3e7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:46.698942 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a4d773f6-3b2c-48be-9937-edc4426cb3e7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:46.707205 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a4d773f6-3b2c-48be-9937-edc4426cb3e7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:46.708698 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a4d773f6-3b2c-48be-9937-edc4426cb3e7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:46.709858 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a4d773f6-3b2c-48be-9937-edc4426cb3e7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.157115 May 13 17:31:46.710409 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 417/849] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:46 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:47.732086 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e9ecd9cf-eede-4804-9950-a7a3a2a332e9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:47.732086 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e9ecd9cf-eede-4804-9950-a7a3a2a332e9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:47.736132 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e9ecd9cf-eede-4804-9950-a7a3a2a332e9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:47.736656 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e9ecd9cf-eede-4804-9950-a7a3a2a332e9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:47.737507 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e9ecd9cf-eede-4804-9950-a7a3a2a332e9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:47.738021 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e9ecd9cf-eede-4804-9950-a7a3a2a332e9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:47.948788 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e9ecd9cf-eede-4804-9950-a7a3a2a332e9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:47.957086 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e9ecd9cf-eede-4804-9950-a7a3a2a332e9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:47.958602 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e9ecd9cf-eede-4804-9950-a7a3a2a332e9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:47.959796 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e9ecd9cf-eede-4804-9950-a7a3a2a332e9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.235508 May 13 17:31:47.960354 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 433/850] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:47 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:48.978521 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-ba8da9f1-539e-4ae2-a06c-34d4327c3c68 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:48.979244 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-ba8da9f1-539e-4ae2-a06c-34d4327c3c68 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:48.985881 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ba8da9f1-539e-4ae2-a06c-34d4327c3c68 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:48.986341 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ba8da9f1-539e-4ae2-a06c-34d4327c3c68 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:48.987142 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ba8da9f1-539e-4ae2-a06c-34d4327c3c68 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:48.987587 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ba8da9f1-539e-4ae2-a06c-34d4327c3c68 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:49.125121 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-ba8da9f1-539e-4ae2-a06c-34d4327c3c68 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:49.134277 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-ba8da9f1-539e-4ae2-a06c-34d4327c3c68 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:49.135808 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-ba8da9f1-539e-4ae2-a06c-34d4327c3c68 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:49.137025 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-ba8da9f1-539e-4ae2-a06c-34d4327c3c68 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.162763 May 13 17:31:49.137593 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 418/851] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:48 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:50.266384 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fa518826-05ad-4990-b5c6-7be419461a71 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:50.267158 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fa518826-05ad-4990-b5c6-7be419461a71 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:50.274250 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fa518826-05ad-4990-b5c6-7be419461a71 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:50.274702 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fa518826-05ad-4990-b5c6-7be419461a71 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:50.275801 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fa518826-05ad-4990-b5c6-7be419461a71 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:50.276450 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fa518826-05ad-4990-b5c6-7be419461a71 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:50.411399 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fa518826-05ad-4990-b5c6-7be419461a71 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:50.419983 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fa518826-05ad-4990-b5c6-7be419461a71 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:50.421597 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fa518826-05ad-4990-b5c6-7be419461a71 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:50.422756 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fa518826-05ad-4990-b5c6-7be419461a71 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.271465 May 13 17:31:50.423375 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 434/852] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:50 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:51.441642 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-0e5bdf37-b115-4d34-8fad-aa5ef611c5b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:51.442255 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-0e5bdf37-b115-4d34-8fad-aa5ef611c5b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:51.449144 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0e5bdf37-b115-4d34-8fad-aa5ef611c5b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:51.449695 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0e5bdf37-b115-4d34-8fad-aa5ef611c5b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:51.450480 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0e5bdf37-b115-4d34-8fad-aa5ef611c5b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:51.450922 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0e5bdf37-b115-4d34-8fad-aa5ef611c5b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:51.598477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0e5bdf37-b115-4d34-8fad-aa5ef611c5b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:51.608382 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0e5bdf37-b115-4d34-8fad-aa5ef611c5b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:51.609862 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0e5bdf37-b115-4d34-8fad-aa5ef611c5b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:51.611281 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-0e5bdf37-b115-4d34-8fad-aa5ef611c5b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.173549 May 13 17:31:51.611841 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 419/853] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:51 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:52.629750 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c4857b32-57bb-48ad-a448-5372d6f6f69e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:52.630354 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c4857b32-57bb-48ad-a448-5372d6f6f69e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:52.636997 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c4857b32-57bb-48ad-a448-5372d6f6f69e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:52.637449 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c4857b32-57bb-48ad-a448-5372d6f6f69e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:52.638219 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c4857b32-57bb-48ad-a448-5372d6f6f69e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:52.638660 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c4857b32-57bb-48ad-a448-5372d6f6f69e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:52.764594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c4857b32-57bb-48ad-a448-5372d6f6f69e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:52.773233 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c4857b32-57bb-48ad-a448-5372d6f6f69e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:52.775269 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c4857b32-57bb-48ad-a448-5372d6f6f69e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:52.776418 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c4857b32-57bb-48ad-a448-5372d6f6f69e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.150512 May 13 17:31:52.776978 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 435/854] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:52 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:53.793756 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1f52c9a7-e48d-4adf-a8a5-e1747e8d52da tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:53.794486 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-1f52c9a7-e48d-4adf-a8a5-e1747e8d52da tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:53.801406 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1f52c9a7-e48d-4adf-a8a5-e1747e8d52da tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:53.801853 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1f52c9a7-e48d-4adf-a8a5-e1747e8d52da tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:53.802624 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1f52c9a7-e48d-4adf-a8a5-e1747e8d52da tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:53.803062 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1f52c9a7-e48d-4adf-a8a5-e1747e8d52da tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:53.953522 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-1f52c9a7-e48d-4adf-a8a5-e1747e8d52da tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:53.962970 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-1f52c9a7-e48d-4adf-a8a5-e1747e8d52da tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:53.964490 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-1f52c9a7-e48d-4adf-a8a5-e1747e8d52da tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:53.965665 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-1f52c9a7-e48d-4adf-a8a5-e1747e8d52da tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.175833 May 13 17:31:53.966229 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 420/855] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:53 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:54.983801 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b6a828bb-b99c-4441-b0f6-4b19e9e74149 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:54.984405 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b6a828bb-b99c-4441-b0f6-4b19e9e74149 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:54.990915 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b6a828bb-b99c-4441-b0f6-4b19e9e74149 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:54.991392 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b6a828bb-b99c-4441-b0f6-4b19e9e74149 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:54.992174 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b6a828bb-b99c-4441-b0f6-4b19e9e74149 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:54.993144 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b6a828bb-b99c-4441-b0f6-4b19e9e74149 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:55.131056 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b6a828bb-b99c-4441-b0f6-4b19e9e74149 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:55.141171 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b6a828bb-b99c-4441-b0f6-4b19e9e74149 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:55.142824 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b6a828bb-b99c-4441-b0f6-4b19e9e74149 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:55.144102 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b6a828bb-b99c-4441-b0f6-4b19e9e74149 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.164164 May 13 17:31:55.145997 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 436/856] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:54 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:56.163684 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a16dbe06-31ca-4eb5-ab1b-4b8f285e1a42 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:56.164342 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a16dbe06-31ca-4eb5-ab1b-4b8f285e1a42 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:56.170593 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a16dbe06-31ca-4eb5-ab1b-4b8f285e1a42 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:56.171075 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a16dbe06-31ca-4eb5-ab1b-4b8f285e1a42 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:56.171921 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a16dbe06-31ca-4eb5-ab1b-4b8f285e1a42 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:56.172363 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a16dbe06-31ca-4eb5-ab1b-4b8f285e1a42 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:56.319220 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a16dbe06-31ca-4eb5-ab1b-4b8f285e1a42 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:56.328282 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a16dbe06-31ca-4eb5-ab1b-4b8f285e1a42 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:56.330997 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a16dbe06-31ca-4eb5-ab1b-4b8f285e1a42 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:56.333197 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a16dbe06-31ca-4eb5-ab1b-4b8f285e1a42 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.173094 May 13 17:31:56.334177 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 421/857] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:56 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:31:57.352039 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-522ec1dc-8c87-4ec6-9993-137a8ff17a1b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:57.352614 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-522ec1dc-8c87-4ec6-9993-137a8ff17a1b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:57.360987 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-522ec1dc-8c87-4ec6-9993-137a8ff17a1b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:57.363307 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-522ec1dc-8c87-4ec6-9993-137a8ff17a1b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:57.364107 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-522ec1dc-8c87-4ec6-9993-137a8ff17a1b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:57.364557 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-522ec1dc-8c87-4ec6-9993-137a8ff17a1b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:57.499970 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-522ec1dc-8c87-4ec6-9993-137a8ff17a1b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:57.508645 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-522ec1dc-8c87-4ec6-9993-137a8ff17a1b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:57.510201 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-522ec1dc-8c87-4ec6-9993-137a8ff17a1b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:57.511417 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-522ec1dc-8c87-4ec6-9993-137a8ff17a1b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.163561 May 13 17:31:57.512169 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 437/858] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:57 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:31:57.798276 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-035199d8-cc44-439b-8a72-968da0d8fa86 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-370542743", "imageRef": "7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88", "flavorRef": "452", "networks": [{"uuid": "43080e60-e3bd-4f01-9af9-50b6a3bc0c46"}]}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:31:57.850063 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.network.neutron [None req-035199d8-cc44-439b-8a72-968da0d8fa86 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] validate_networks() for [('43080e60-e3bd-4f01-9af9-50b6a3bc0c46', None, None, None, None, None)] {{(pid=117492) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 17:31:58.448280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-035199d8-cc44-439b-8a72-968da0d8fa86 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Flavor limits 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 17:31:58.449118 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-035199d8-cc44-439b-8a72-968da0d8fa86 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Image limits 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 17:31:58.449604 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-035199d8-cc44-439b-8a72-968da0d8fa86 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Flavor pref 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 17:31:58.450016 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-035199d8-cc44-439b-8a72-968da0d8fa86 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Image pref 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 17:31:58.450432 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-035199d8-cc44-439b-8a72-968da0d8fa86 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 17:31:58.459306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-035199d8-cc44-439b-8a72-968da0d8fa86 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:58.459758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-035199d8-cc44-439b-8a72-968da0d8fa86 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:58.460854 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-035199d8-cc44-439b-8a72-968da0d8fa86 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:58.461297 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-035199d8-cc44-439b-8a72-968da0d8fa86 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:58.478895 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-035199d8-cc44-439b-8a72-968da0d8fa86 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Getting quotas for project e9f5f08db8cb40f0857115f4c9aadaf7. Resources: {'ram', 'instances', 'cores'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:31:58.483100 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-035199d8-cc44-439b-8a72-968da0d8fa86 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Getting quotas for user 00983ee7706f43d4b3f7d0f178c0e924 and project e9f5f08db8cb40f0857115f4c9aadaf7. Resources: {'ram', 'instances', 'cores'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:31:58.495031 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-035199d8-cc44-439b-8a72-968da0d8fa86 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Going to run 1 instances... {{(pid=117492) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 17:31:58.497406 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-035199d8-cc44-439b-8a72-968da0d8fa86 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 17:31:58.529837 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5288518c-880a-4bc6-be11-7bd053dd68c7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:58.530446 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5288518c-880a-4bc6-be11-7bd053dd68c7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:58.537007 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5288518c-880a-4bc6-be11-7bd053dd68c7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:58.537538 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5288518c-880a-4bc6-be11-7bd053dd68c7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:58.538318 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5288518c-880a-4bc6-be11-7bd053dd68c7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:58.538963 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5288518c-880a-4bc6-be11-7bd053dd68c7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:58.632837 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-035199d8-cc44-439b-8a72-968da0d8fa86 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.838288 May 13 17:31:58.633813 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 422/859] 10.222.0.64 () {60 vars in 1146 bytes} [Fri May 13 17:31:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 840 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 17:31:58.643616 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7f5b91ec-4ba8-4178-924c-26d86b30a38a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:58.644338 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7f5b91ec-4ba8-4178-924c-26d86b30a38a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:58.690487 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5288518c-880a-4bc6-be11-7bd053dd68c7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:58.698879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5288518c-880a-4bc6-be11-7bd053dd68c7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:58.700415 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5288518c-880a-4bc6-be11-7bd053dd68c7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:58.701600 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5288518c-880a-4bc6-be11-7bd053dd68c7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.175626 May 13 17:31:58.702169 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 438/860] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:58 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:31:58.720455 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7f5b91ec-4ba8-4178-924c-26d86b30a38a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:58.727307 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7f5b91ec-4ba8-4178-924c-26d86b30a38a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1218 microversion: 2.1 time: 0.087587 May 13 17:31:58.727882 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 423/861] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:58 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:31:59.727289 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3f3437d7-cbf5-44a7-a3fd-e2c5115c0a42 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:59.727289 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3f3437d7-cbf5-44a7-a3fd-e2c5115c0a42 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:59.727289 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3f3437d7-cbf5-44a7-a3fd-e2c5115c0a42 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:59.728072 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3f3437d7-cbf5-44a7-a3fd-e2c5115c0a42 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:59.728251 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3f3437d7-cbf5-44a7-a3fd-e2c5115c0a42 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:59.728690 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3f3437d7-cbf5-44a7-a3fd-e2c5115c0a42 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:59.746206 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-bde8aefc-d844-48b6-baa8-d92481148d3a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:31:59.746900 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-bde8aefc-d844-48b6-baa8-d92481148d3a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:31:59.753303 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bde8aefc-d844-48b6-baa8-d92481148d3a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:59.753948 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bde8aefc-d844-48b6-baa8-d92481148d3a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:59.754810 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bde8aefc-d844-48b6-baa8-d92481148d3a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:31:59.755353 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bde8aefc-d844-48b6-baa8-d92481148d3a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:31:59.838132 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-bde8aefc-d844-48b6-baa8-d92481148d3a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:59.845100 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-bde8aefc-d844-48b6-baa8-d92481148d3a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1222 microversion: 2.1 time: 0.103504 May 13 17:31:59.845922 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 424/862] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:31:59 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1222 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:31:59.874004 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3f3437d7-cbf5-44a7-a3fd-e2c5115c0a42 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:59.882984 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3f3437d7-cbf5-44a7-a3fd-e2c5115c0a42 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:59.884839 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3f3437d7-cbf5-44a7-a3fd-e2c5115c0a42 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:31:59.886043 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3f3437d7-cbf5-44a7-a3fd-e2c5115c0a42 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.170120 May 13 17:31:59.886600 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 439/863] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:31:59 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:00.863212 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7e63b6d4-d96e-42a1-9a40-4e0d82f7b275 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:00.864012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7e63b6d4-d96e-42a1-9a40-4e0d82f7b275 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:00.870643 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7e63b6d4-d96e-42a1-9a40-4e0d82f7b275 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:00.871084 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7e63b6d4-d96e-42a1-9a40-4e0d82f7b275 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:00.871950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7e63b6d4-d96e-42a1-9a40-4e0d82f7b275 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:00.872379 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7e63b6d4-d96e-42a1-9a40-4e0d82f7b275 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:00.904813 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fd737868-3c7d-486c-b005-7e25390ed1d4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:00.905538 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fd737868-3c7d-486c-b005-7e25390ed1d4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:00.912272 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fd737868-3c7d-486c-b005-7e25390ed1d4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:00.912810 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fd737868-3c7d-486c-b005-7e25390ed1d4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:00.913979 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fd737868-3c7d-486c-b005-7e25390ed1d4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:00.914494 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fd737868-3c7d-486c-b005-7e25390ed1d4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:00.934919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7e63b6d4-d96e-42a1-9a40-4e0d82f7b275 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:00.942920 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7e63b6d4-d96e-42a1-9a40-4e0d82f7b275 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1222 microversion: 2.1 time: 0.083712 May 13 17:32:00.947263 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 425/864] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:32:00 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:32:01.052897 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fd737868-3c7d-486c-b005-7e25390ed1d4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:01.061858 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fd737868-3c7d-486c-b005-7e25390ed1d4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:01.063459 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fd737868-3c7d-486c-b005-7e25390ed1d4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:01.064620 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fd737868-3c7d-486c-b005-7e25390ed1d4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.164132 May 13 17:32:01.065186 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 440/865] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:00 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:01.960653 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-daf59a6b-dea7-4a2a-bcc4-57199cf5726d tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:01.961250 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-daf59a6b-dea7-4a2a-bcc4-57199cf5726d tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:01.968977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-daf59a6b-dea7-4a2a-bcc4-57199cf5726d tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:01.969536 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-daf59a6b-dea7-4a2a-bcc4-57199cf5726d tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:01.970381 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-daf59a6b-dea7-4a2a-bcc4-57199cf5726d tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:01.970880 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-daf59a6b-dea7-4a2a-bcc4-57199cf5726d tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:02.036373 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-daf59a6b-dea7-4a2a-bcc4-57199cf5726d tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:02.043940 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-daf59a6b-dea7-4a2a-bcc4-57199cf5726d tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1222 microversion: 2.1 time: 0.087363 May 13 17:32:02.044523 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 426/866] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:32:01 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:32:02.082756 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-badd93a8-1b87-4ece-a6cb-aaa960bbc7b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:02.083391 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-badd93a8-1b87-4ece-a6cb-aaa960bbc7b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:02.090300 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-badd93a8-1b87-4ece-a6cb-aaa960bbc7b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:02.090755 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-badd93a8-1b87-4ece-a6cb-aaa960bbc7b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:02.091556 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-badd93a8-1b87-4ece-a6cb-aaa960bbc7b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:02.091997 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-badd93a8-1b87-4ece-a6cb-aaa960bbc7b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:02.225717 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-badd93a8-1b87-4ece-a6cb-aaa960bbc7b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:02.234085 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-badd93a8-1b87-4ece-a6cb-aaa960bbc7b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:02.235577 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-badd93a8-1b87-4ece-a6cb-aaa960bbc7b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:02.236726 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-badd93a8-1b87-4ece-a6cb-aaa960bbc7b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.157843 May 13 17:32:02.237295 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 441/867] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:02 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:03.061301 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7afc6b18-0818-4f5e-928f-affa2a5ec692 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:03.062054 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7afc6b18-0818-4f5e-928f-affa2a5ec692 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:03.069143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7afc6b18-0818-4f5e-928f-affa2a5ec692 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:03.069690 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7afc6b18-0818-4f5e-928f-affa2a5ec692 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:03.070744 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7afc6b18-0818-4f5e-928f-affa2a5ec692 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:03.071286 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7afc6b18-0818-4f5e-928f-affa2a5ec692 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:03.132661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7afc6b18-0818-4f5e-928f-affa2a5ec692 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:03.140887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7afc6b18-0818-4f5e-928f-affa2a5ec692 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1222 microversion: 2.1 time: 0.084043 May 13 17:32:03.141503 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 427/868] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:32:03 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:32:03.255257 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0d495617-ae70-4b82-a92c-64cf5840b969 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:03.255864 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0d495617-ae70-4b82-a92c-64cf5840b969 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:03.262273 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0d495617-ae70-4b82-a92c-64cf5840b969 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:03.262722 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0d495617-ae70-4b82-a92c-64cf5840b969 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:03.263518 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0d495617-ae70-4b82-a92c-64cf5840b969 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:03.263957 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0d495617-ae70-4b82-a92c-64cf5840b969 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:03.392101 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0d495617-ae70-4b82-a92c-64cf5840b969 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:03.401847 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0d495617-ae70-4b82-a92c-64cf5840b969 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:03.404220 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0d495617-ae70-4b82-a92c-64cf5840b969 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:03.404851 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0d495617-ae70-4b82-a92c-64cf5840b969 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.153459 May 13 17:32:03.407737 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 442/869] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:03 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:04.157920 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-902bcaf9-3e55-4669-ad02-b91b8b6a705a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:04.164018 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-902bcaf9-3e55-4669-ad02-b91b8b6a705a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:04.173006 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-902bcaf9-3e55-4669-ad02-b91b8b6a705a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:04.173253 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-902bcaf9-3e55-4669-ad02-b91b8b6a705a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:04.174055 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-902bcaf9-3e55-4669-ad02-b91b8b6a705a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:04.174554 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-902bcaf9-3e55-4669-ad02-b91b8b6a705a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:04.238040 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-902bcaf9-3e55-4669-ad02-b91b8b6a705a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:04.245626 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-902bcaf9-3e55-4669-ad02-b91b8b6a705a tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1222 microversion: 2.1 time: 0.091578 May 13 17:32:04.246139 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 428/870] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:32:04 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:32:04.422747 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7725af1b-739b-406c-8de1-bdd53fff5971 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:04.423408 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7725af1b-739b-406c-8de1-bdd53fff5971 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:04.429821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7725af1b-739b-406c-8de1-bdd53fff5971 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:04.430273 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7725af1b-739b-406c-8de1-bdd53fff5971 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:04.431045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7725af1b-739b-406c-8de1-bdd53fff5971 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:04.431517 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7725af1b-739b-406c-8de1-bdd53fff5971 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:04.568641 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7725af1b-739b-406c-8de1-bdd53fff5971 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:04.578776 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7725af1b-739b-406c-8de1-bdd53fff5971 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:04.580334 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7725af1b-739b-406c-8de1-bdd53fff5971 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:04.581529 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7725af1b-739b-406c-8de1-bdd53fff5971 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.162683 May 13 17:32:04.582092 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 443/871] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:04 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:05.262467 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-e095d7a7-809e-4963-8fc0-e49a56015e05 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:05.263384 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-e095d7a7-809e-4963-8fc0-e49a56015e05 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:05.269757 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e095d7a7-809e-4963-8fc0-e49a56015e05 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:05.270214 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e095d7a7-809e-4963-8fc0-e49a56015e05 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:05.271074 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e095d7a7-809e-4963-8fc0-e49a56015e05 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:05.271542 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e095d7a7-809e-4963-8fc0-e49a56015e05 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:05.334017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-e095d7a7-809e-4963-8fc0-e49a56015e05 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:05.342022 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-e095d7a7-809e-4963-8fc0-e49a56015e05 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1222 microversion: 2.1 time: 0.084012 May 13 17:32:05.342639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 429/872] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:32:05 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:32:05.600757 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7f26e44d-72a5-4335-aae7-ae600c29bc4e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:05.601327 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7f26e44d-72a5-4335-aae7-ae600c29bc4e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:05.608287 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7f26e44d-72a5-4335-aae7-ae600c29bc4e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:05.608736 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7f26e44d-72a5-4335-aae7-ae600c29bc4e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:05.609502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7f26e44d-72a5-4335-aae7-ae600c29bc4e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:05.609937 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7f26e44d-72a5-4335-aae7-ae600c29bc4e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:05.743655 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7f26e44d-72a5-4335-aae7-ae600c29bc4e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:05.751889 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7f26e44d-72a5-4335-aae7-ae600c29bc4e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:05.753375 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7f26e44d-72a5-4335-aae7-ae600c29bc4e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:05.754526 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7f26e44d-72a5-4335-aae7-ae600c29bc4e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.158086 May 13 17:32:05.755087 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 444/873] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:05 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:06.359511 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-79047559-99ef-4740-bd47-b7fa927f38d6 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:06.360110 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-79047559-99ef-4740-bd47-b7fa927f38d6 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:06.366566 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-79047559-99ef-4740-bd47-b7fa927f38d6 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:06.367008 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-79047559-99ef-4740-bd47-b7fa927f38d6 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:06.367806 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-79047559-99ef-4740-bd47-b7fa927f38d6 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:06.368240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-79047559-99ef-4740-bd47-b7fa927f38d6 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:06.431612 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-79047559-99ef-4740-bd47-b7fa927f38d6 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:06.439586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-79047559-99ef-4740-bd47-b7fa927f38d6 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1222 microversion: 2.1 time: 0.083831 May 13 17:32:06.440163 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 430/874] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:32:06 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:32:06.773389 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-014239a7-481d-47ff-9e2e-0c36bb261144 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:06.773992 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-014239a7-481d-47ff-9e2e-0c36bb261144 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:06.780977 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-014239a7-481d-47ff-9e2e-0c36bb261144 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:06.781425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-014239a7-481d-47ff-9e2e-0c36bb261144 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:06.782189 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-014239a7-481d-47ff-9e2e-0c36bb261144 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:06.782631 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-014239a7-481d-47ff-9e2e-0c36bb261144 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:06.910268 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-014239a7-481d-47ff-9e2e-0c36bb261144 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:06.919175 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-014239a7-481d-47ff-9e2e-0c36bb261144 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:06.920673 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-014239a7-481d-47ff-9e2e-0c36bb261144 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:06.921839 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-014239a7-481d-47ff-9e2e-0c36bb261144 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.152356 May 13 17:32:06.922400 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 445/875] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:06 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:07.456961 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-adc2cfed-2bb4-4548-90a4-e07c7b9ca489 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:07.457572 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-adc2cfed-2bb4-4548-90a4-e07c7b9ca489 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:07.464495 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-adc2cfed-2bb4-4548-90a4-e07c7b9ca489 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:07.464944 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-adc2cfed-2bb4-4548-90a4-e07c7b9ca489 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:07.465714 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-adc2cfed-2bb4-4548-90a4-e07c7b9ca489 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:07.466152 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-adc2cfed-2bb4-4548-90a4-e07c7b9ca489 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:07.528221 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-adc2cfed-2bb4-4548-90a4-e07c7b9ca489 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:07.535423 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-adc2cfed-2bb4-4548-90a4-e07c7b9ca489 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1222 microversion: 2.1 time: 0.082307 May 13 17:32:07.536002 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 431/876] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:32:07 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1222 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:32:07.940404 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5f784957-644c-4bda-b9a1-e0af7153c312 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:07.941016 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5f784957-644c-4bda-b9a1-e0af7153c312 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:07.947366 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5f784957-644c-4bda-b9a1-e0af7153c312 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:07.947817 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5f784957-644c-4bda-b9a1-e0af7153c312 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:07.948585 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5f784957-644c-4bda-b9a1-e0af7153c312 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:07.949027 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5f784957-644c-4bda-b9a1-e0af7153c312 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:08.078965 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5f784957-644c-4bda-b9a1-e0af7153c312 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:08.087144 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5f784957-644c-4bda-b9a1-e0af7153c312 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:08.088639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5f784957-644c-4bda-b9a1-e0af7153c312 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:08.089786 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5f784957-644c-4bda-b9a1-e0af7153c312 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.153298 May 13 17:32:08.090349 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 446/877] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:07 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:08.551457 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-0d3120c8-4918-4bf2-8001-e56ed2e2eef0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:08.552063 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-0d3120c8-4918-4bf2-8001-e56ed2e2eef0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:08.558267 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0d3120c8-4918-4bf2-8001-e56ed2e2eef0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:08.558711 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0d3120c8-4918-4bf2-8001-e56ed2e2eef0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:08.559494 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0d3120c8-4918-4bf2-8001-e56ed2e2eef0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:08.559933 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0d3120c8-4918-4bf2-8001-e56ed2e2eef0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:08.619957 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0d3120c8-4918-4bf2-8001-e56ed2e2eef0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:08.627001 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-0d3120c8-4918-4bf2-8001-e56ed2e2eef0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1222 microversion: 2.1 time: 0.079343 May 13 17:32:08.627601 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 432/878] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:32:08 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:32:09.108331 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5bc396d2-ecca-4524-ab83-1ccbfd9977c7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:09.108938 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5bc396d2-ecca-4524-ab83-1ccbfd9977c7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:09.115256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5bc396d2-ecca-4524-ab83-1ccbfd9977c7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:09.115711 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5bc396d2-ecca-4524-ab83-1ccbfd9977c7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:09.116477 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5bc396d2-ecca-4524-ab83-1ccbfd9977c7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:09.116917 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5bc396d2-ecca-4524-ab83-1ccbfd9977c7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:09.240419 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5bc396d2-ecca-4524-ab83-1ccbfd9977c7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:09.249108 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5bc396d2-ecca-4524-ab83-1ccbfd9977c7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:09.250540 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5bc396d2-ecca-4524-ab83-1ccbfd9977c7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:09.251737 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5bc396d2-ecca-4524-ab83-1ccbfd9977c7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.147317 May 13 17:32:09.252309 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 447/879] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:09 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:09.643583 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-c4e30aba-e3e7-4e47-860d-1d21dfd6f8eb tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:09.644197 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-c4e30aba-e3e7-4e47-860d-1d21dfd6f8eb tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:09.650489 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c4e30aba-e3e7-4e47-860d-1d21dfd6f8eb tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:09.650939 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c4e30aba-e3e7-4e47-860d-1d21dfd6f8eb tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:09.651740 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c4e30aba-e3e7-4e47-860d-1d21dfd6f8eb tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:09.652189 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c4e30aba-e3e7-4e47-860d-1d21dfd6f8eb tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:09.713218 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c4e30aba-e3e7-4e47-860d-1d21dfd6f8eb tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:09.725039 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-c4e30aba-e3e7-4e47-860d-1d21dfd6f8eb tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1222 microversion: 2.1 time: 0.084403 May 13 17:32:09.725039 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 433/880] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:32:09 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1222 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:32:10.270304 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-dba443ea-0b46-4728-b130-7263d221ba6e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:10.270827 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-dba443ea-0b46-4728-b130-7263d221ba6e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:10.277711 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dba443ea-0b46-4728-b130-7263d221ba6e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:10.278168 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dba443ea-0b46-4728-b130-7263d221ba6e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:10.278938 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dba443ea-0b46-4728-b130-7263d221ba6e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:10.279473 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dba443ea-0b46-4728-b130-7263d221ba6e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:10.408252 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-dba443ea-0b46-4728-b130-7263d221ba6e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:10.416479 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-dba443ea-0b46-4728-b130-7263d221ba6e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:10.418034 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-dba443ea-0b46-4728-b130-7263d221ba6e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:10.419215 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-dba443ea-0b46-4728-b130-7263d221ba6e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.152869 May 13 17:32:10.419781 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 448/881] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:10 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:10.741450 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-73ea0770-481e-4f44-ab05-b338af20b1a3 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:10.742056 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-73ea0770-481e-4f44-ab05-b338af20b1a3 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:10.748884 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-73ea0770-481e-4f44-ab05-b338af20b1a3 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:10.749330 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-73ea0770-481e-4f44-ab05-b338af20b1a3 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:10.750100 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-73ea0770-481e-4f44-ab05-b338af20b1a3 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:10.750540 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-73ea0770-481e-4f44-ab05-b338af20b1a3 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:10.809931 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-73ea0770-481e-4f44-ab05-b338af20b1a3 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:10.817088 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-73ea0770-481e-4f44-ab05-b338af20b1a3 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1214 microversion: 2.1 time: 0.079531 May 13 17:32:10.817672 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 434/882] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:32:10 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:32:11.437476 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-60212105-27ce-4d9c-a66c-e8deecbd8be1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:11.438083 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-60212105-27ce-4d9c-a66c-e8deecbd8be1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:11.444524 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-60212105-27ce-4d9c-a66c-e8deecbd8be1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:11.444966 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-60212105-27ce-4d9c-a66c-e8deecbd8be1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:11.445732 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-60212105-27ce-4d9c-a66c-e8deecbd8be1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:11.446163 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-60212105-27ce-4d9c-a66c-e8deecbd8be1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:11.658422 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-60212105-27ce-4d9c-a66c-e8deecbd8be1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:11.667227 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-60212105-27ce-4d9c-a66c-e8deecbd8be1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:11.668842 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-60212105-27ce-4d9c-a66c-e8deecbd8be1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:11.669993 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-60212105-27ce-4d9c-a66c-e8deecbd8be1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.236479 May 13 17:32:11.670558 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 449/883] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:11 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:11.833929 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d0a1c4d4-ddea-4bb3-964c-4fcc96179c35 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:11.834532 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d0a1c4d4-ddea-4bb3-964c-4fcc96179c35 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:11.843752 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d0a1c4d4-ddea-4bb3-964c-4fcc96179c35 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:11.845303 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d0a1c4d4-ddea-4bb3-964c-4fcc96179c35 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:11.846120 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d0a1c4d4-ddea-4bb3-964c-4fcc96179c35 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:11.846568 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d0a1c4d4-ddea-4bb3-964c-4fcc96179c35 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:11.914454 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d0a1c4d4-ddea-4bb3-964c-4fcc96179c35 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:11.922653 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d0a1c4d4-ddea-4bb3-964c-4fcc96179c35 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1276 microversion: 2.1 time: 0.092618 May 13 17:32:11.923258 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 435/884] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:32:11 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1276 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:32:12.688507 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d4120d58-de16-4456-9b72-b8cab7ab7267 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:12.689088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d4120d58-de16-4456-9b72-b8cab7ab7267 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:12.695283 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d4120d58-de16-4456-9b72-b8cab7ab7267 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:12.695734 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d4120d58-de16-4456-9b72-b8cab7ab7267 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:12.696490 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d4120d58-de16-4456-9b72-b8cab7ab7267 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:12.696922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d4120d58-de16-4456-9b72-b8cab7ab7267 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:12.844991 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d4120d58-de16-4456-9b72-b8cab7ab7267 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:12.853565 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d4120d58-de16-4456-9b72-b8cab7ab7267 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:12.856129 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d4120d58-de16-4456-9b72-b8cab7ab7267 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:12.856274 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d4120d58-de16-4456-9b72-b8cab7ab7267 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.171616 May 13 17:32:12.856841 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 450/885] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:12 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:32:12.941931 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f4c38aeb-0ab1-4908-991b-7574471958b7 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:12.942451 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-f4c38aeb-0ab1-4908-991b-7574471958b7 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:12.949313 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f4c38aeb-0ab1-4908-991b-7574471958b7 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:12.949755 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f4c38aeb-0ab1-4908-991b-7574471958b7 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:12.950513 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f4c38aeb-0ab1-4908-991b-7574471958b7 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:12.950942 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f4c38aeb-0ab1-4908-991b-7574471958b7 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:13.078428 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f4c38aeb-0ab1-4908-991b-7574471958b7 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:13.085685 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f4c38aeb-0ab1-4908-991b-7574471958b7 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1318 microversion: 2.1 time: 0.147850 May 13 17:32:13.087667 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 436/886] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:32:12 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:32:13.240770 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-deefe02a-730c-4e3c-806e-1dfee81ddb29 req-93342c29-9b78-4cd5-9049-ca048ec474a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43b2b263-fb7a-4fe9-abaa-2df5d8c901c2", "tag": "184e5bd1-70c3-49ee-b517-f4be3467d55c"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:32:13.249242 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-deefe02a-730c-4e3c-806e-1dfee81ddb29 req-93342c29-9b78-4cd5-9049-ca048ec474a8 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:13.249685 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-deefe02a-730c-4e3c-806e-1dfee81ddb29 req-93342c29-9b78-4cd5-9049-ca048ec474a8 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:13.260050 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-deefe02a-730c-4e3c-806e-1dfee81ddb29 req-93342c29-9b78-4cd5-9049-ca048ec474a8 service nova] Creating event network-changed:184e5bd1-70c3-49ee-b517-f4be3467d55c for instance 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 on hv-cinder-84178 May 13 17:32:13.264820 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-deefe02a-730c-4e3c-806e-1dfee81ddb29 req-93342c29-9b78-4cd5-9049-ca048ec474a8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081269 May 13 17:32:13.265431 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 451/887] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:32:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:32:13.874250 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-49298fd5-1ea4-412f-962b-216dbb3bdb59 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:13.875410 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-49298fd5-1ea4-412f-962b-216dbb3bdb59 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:13.881084 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-49298fd5-1ea4-412f-962b-216dbb3bdb59 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:13.884061 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-49298fd5-1ea4-412f-962b-216dbb3bdb59 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:13.884061 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-49298fd5-1ea4-412f-962b-216dbb3bdb59 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:13.884061 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-49298fd5-1ea4-412f-962b-216dbb3bdb59 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:14.010057 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-49298fd5-1ea4-412f-962b-216dbb3bdb59 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:14.018640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-49298fd5-1ea4-412f-962b-216dbb3bdb59 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:14.020171 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-49298fd5-1ea4-412f-962b-216dbb3bdb59 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:14.021324 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-49298fd5-1ea4-412f-962b-216dbb3bdb59 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.150951 May 13 17:32:14.021893 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 437/888] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:13 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:14.103735 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-024ed723-b86e-46fb-bcc9-97b13af841ee tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:14.104434 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-024ed723-b86e-46fb-bcc9-97b13af841ee tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:14.110437 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-024ed723-b86e-46fb-bcc9-97b13af841ee tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:14.110884 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-024ed723-b86e-46fb-bcc9-97b13af841ee tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:14.111672 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-024ed723-b86e-46fb-bcc9-97b13af841ee tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:14.112110 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-024ed723-b86e-46fb-bcc9-97b13af841ee tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:14.239418 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-024ed723-b86e-46fb-bcc9-97b13af841ee tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:14.246789 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-024ed723-b86e-46fb-bcc9-97b13af841ee tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1318 microversion: 2.1 time: 0.147707 May 13 17:32:14.247389 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 452/889] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:32:14 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:32:15.040159 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-acc4db0d-a49c-4851-8d38-f7fcd5425271 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:15.040774 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-acc4db0d-a49c-4851-8d38-f7fcd5425271 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:15.047677 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-acc4db0d-a49c-4851-8d38-f7fcd5425271 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:15.048122 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-acc4db0d-a49c-4851-8d38-f7fcd5425271 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:15.048895 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-acc4db0d-a49c-4851-8d38-f7fcd5425271 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:15.049332 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-acc4db0d-a49c-4851-8d38-f7fcd5425271 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:15.177628 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-acc4db0d-a49c-4851-8d38-f7fcd5425271 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:15.185830 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-acc4db0d-a49c-4851-8d38-f7fcd5425271 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:15.187379 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-acc4db0d-a49c-4851-8d38-f7fcd5425271 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:15.188548 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-acc4db0d-a49c-4851-8d38-f7fcd5425271 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.152300 May 13 17:32:15.189115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 438/890] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:15 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:15.263286 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-43280dc1-3c43-4b13-be36-00580bad2722 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:15.263824 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-43280dc1-3c43-4b13-be36-00580bad2722 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:15.270002 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-43280dc1-3c43-4b13-be36-00580bad2722 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:15.270451 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-43280dc1-3c43-4b13-be36-00580bad2722 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:15.271240 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-43280dc1-3c43-4b13-be36-00580bad2722 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:15.271677 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-43280dc1-3c43-4b13-be36-00580bad2722 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:15.399568 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-43280dc1-3c43-4b13-be36-00580bad2722 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:15.411292 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-43280dc1-3c43-4b13-be36-00580bad2722 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1318 microversion: 2.1 time: 0.148133 May 13 17:32:15.411292 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 453/891] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:32:15 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:32:16.207236 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f2d3fd29-70f4-4a3c-94ca-6e948d9468fc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:16.207874 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-f2d3fd29-70f4-4a3c-94ca-6e948d9468fc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:16.214244 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f2d3fd29-70f4-4a3c-94ca-6e948d9468fc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:16.214698 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f2d3fd29-70f4-4a3c-94ca-6e948d9468fc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:16.215499 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f2d3fd29-70f4-4a3c-94ca-6e948d9468fc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:16.215946 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f2d3fd29-70f4-4a3c-94ca-6e948d9468fc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:16.340966 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f2d3fd29-70f4-4a3c-94ca-6e948d9468fc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:16.349428 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f2d3fd29-70f4-4a3c-94ca-6e948d9468fc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:16.350923 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f2d3fd29-70f4-4a3c-94ca-6e948d9468fc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:16.352119 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f2d3fd29-70f4-4a3c-94ca-6e948d9468fc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.149020 May 13 17:32:16.352690 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 439/892] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:16 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:16.425048 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9824e30a-39e2-4d47-a89b-c2a92342bce6 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:16.425666 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9824e30a-39e2-4d47-a89b-c2a92342bce6 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:16.432280 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9824e30a-39e2-4d47-a89b-c2a92342bce6 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:16.433327 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9824e30a-39e2-4d47-a89b-c2a92342bce6 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:16.434111 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9824e30a-39e2-4d47-a89b-c2a92342bce6 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:16.438328 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9824e30a-39e2-4d47-a89b-c2a92342bce6 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:16.562794 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9824e30a-39e2-4d47-a89b-c2a92342bce6 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:16.569953 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9824e30a-39e2-4d47-a89b-c2a92342bce6 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1318 microversion: 2.1 time: 0.149172 May 13 17:32:16.570523 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 454/893] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:32:16 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:32:17.370186 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-0fab93c2-951e-43da-aa6b-1ac97d23e002 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:17.371331 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-0fab93c2-951e-43da-aa6b-1ac97d23e002 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:17.377680 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0fab93c2-951e-43da-aa6b-1ac97d23e002 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:17.378123 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0fab93c2-951e-43da-aa6b-1ac97d23e002 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:17.378876 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0fab93c2-951e-43da-aa6b-1ac97d23e002 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:17.379348 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0fab93c2-951e-43da-aa6b-1ac97d23e002 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:17.506311 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0fab93c2-951e-43da-aa6b-1ac97d23e002 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:17.515160 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0fab93c2-951e-43da-aa6b-1ac97d23e002 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:17.516646 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0fab93c2-951e-43da-aa6b-1ac97d23e002 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:17.517790 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-0fab93c2-951e-43da-aa6b-1ac97d23e002 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.151490 May 13 17:32:17.518346 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 440/894] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:17 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:17.586356 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f803770a-d204-4550-8a98-965a9335f3e5 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:17.586963 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f803770a-d204-4550-8a98-965a9335f3e5 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:17.593238 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f803770a-d204-4550-8a98-965a9335f3e5 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:17.593686 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f803770a-d204-4550-8a98-965a9335f3e5 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:17.594462 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f803770a-d204-4550-8a98-965a9335f3e5 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:17.594893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f803770a-d204-4550-8a98-965a9335f3e5 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:17.721251 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f803770a-d204-4550-8a98-965a9335f3e5 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:17.728721 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f803770a-d204-4550-8a98-965a9335f3e5 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1318 microversion: 2.1 time: 0.146125 May 13 17:32:17.729296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 455/895] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:32:17 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:32:18.536179 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-fac2d8a6-01e4-4051-aa36-3199d70a9ad1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:18.536807 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-fac2d8a6-01e4-4051-aa36-3199d70a9ad1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:18.543038 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fac2d8a6-01e4-4051-aa36-3199d70a9ad1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:18.543516 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fac2d8a6-01e4-4051-aa36-3199d70a9ad1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:18.544293 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fac2d8a6-01e4-4051-aa36-3199d70a9ad1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:18.544747 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fac2d8a6-01e4-4051-aa36-3199d70a9ad1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:18.670716 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-fac2d8a6-01e4-4051-aa36-3199d70a9ad1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:18.679098 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-fac2d8a6-01e4-4051-aa36-3199d70a9ad1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:18.680590 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-fac2d8a6-01e4-4051-aa36-3199d70a9ad1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:18.681728 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-fac2d8a6-01e4-4051-aa36-3199d70a9ad1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.149417 May 13 17:32:18.682287 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 441/896] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:18 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:18.745681 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9f45163f-26c7-4a4a-a2bb-2c364e19d2a6 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:18.746295 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9f45163f-26c7-4a4a-a2bb-2c364e19d2a6 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:18.753102 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9f45163f-26c7-4a4a-a2bb-2c364e19d2a6 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:18.753571 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9f45163f-26c7-4a4a-a2bb-2c364e19d2a6 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:18.754323 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9f45163f-26c7-4a4a-a2bb-2c364e19d2a6 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:18.754762 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9f45163f-26c7-4a4a-a2bb-2c364e19d2a6 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:18.881940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9f45163f-26c7-4a4a-a2bb-2c364e19d2a6 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:18.886746 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9f45163f-26c7-4a4a-a2bb-2c364e19d2a6 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1318 microversion: 2.1 time: 0.144924 May 13 17:32:18.887350 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 456/897] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:32:18 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:32:19.699202 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-bb4e3d50-bca9-4b75-b2fc-e757e7e1763d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:19.699807 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-bb4e3d50-bca9-4b75-b2fc-e757e7e1763d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:19.706496 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bb4e3d50-bca9-4b75-b2fc-e757e7e1763d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:19.706937 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bb4e3d50-bca9-4b75-b2fc-e757e7e1763d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:19.707727 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bb4e3d50-bca9-4b75-b2fc-e757e7e1763d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:19.708160 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bb4e3d50-bca9-4b75-b2fc-e757e7e1763d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:19.838136 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-bb4e3d50-bca9-4b75-b2fc-e757e7e1763d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:19.847276 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-bb4e3d50-bca9-4b75-b2fc-e757e7e1763d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:19.849126 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-bb4e3d50-bca9-4b75-b2fc-e757e7e1763d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:19.850312 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-bb4e3d50-bca9-4b75-b2fc-e757e7e1763d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.154986 May 13 17:32:19.850885 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 442/898] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:19 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:19.904467 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2cb20014-2b03-48b2-bb85-8d602f1d7d91 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:19.904990 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2cb20014-2b03-48b2-bb85-8d602f1d7d91 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:19.912192 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2cb20014-2b03-48b2-bb85-8d602f1d7d91 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:19.912645 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2cb20014-2b03-48b2-bb85-8d602f1d7d91 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:19.914477 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2cb20014-2b03-48b2-bb85-8d602f1d7d91 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:19.914477 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2cb20014-2b03-48b2-bb85-8d602f1d7d91 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:20.115755 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2cb20014-2b03-48b2-bb85-8d602f1d7d91 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:20.123452 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2cb20014-2b03-48b2-bb85-8d602f1d7d91 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1318 microversion: 2.1 time: 0.223121 May 13 17:32:20.123990 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 457/899] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:32:19 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:32:20.681059 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-43afff86-a064-4242-8f16-790d8aeda7e9 req-05b04420-6522-4c5f-b638-b863636fb36d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43b2b263-fb7a-4fe9-abaa-2df5d8c901c2", "name": "network-vif-plugged", "status": "completed", "tag": "184e5bd1-70c3-49ee-b517-f4be3467d55c"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:32:20.689052 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-43afff86-a064-4242-8f16-790d8aeda7e9 req-05b04420-6522-4c5f-b638-b863636fb36d service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:20.689497 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-43afff86-a064-4242-8f16-790d8aeda7e9 req-05b04420-6522-4c5f-b638-b863636fb36d service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:20.700121 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-43afff86-a064-4242-8f16-790d8aeda7e9 req-05b04420-6522-4c5f-b638-b863636fb36d service nova] Creating event network-vif-plugged:184e5bd1-70c3-49ee-b517-f4be3467d55c for instance 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 on hv-cinder-84178 May 13 17:32:20.705569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-43afff86-a064-4242-8f16-790d8aeda7e9 req-05b04420-6522-4c5f-b638-b863636fb36d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028227 May 13 17:32:20.706153 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 443/900] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:32:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:32:20.868596 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5d61051b-b04f-4b1a-be26-388c0a99da4c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:20.869206 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5d61051b-b04f-4b1a-be26-388c0a99da4c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:20.875045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5d61051b-b04f-4b1a-be26-388c0a99da4c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:20.876817 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5d61051b-b04f-4b1a-be26-388c0a99da4c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:20.876817 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5d61051b-b04f-4b1a-be26-388c0a99da4c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:20.876817 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5d61051b-b04f-4b1a-be26-388c0a99da4c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:21.009547 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5d61051b-b04f-4b1a-be26-388c0a99da4c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:21.019276 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5d61051b-b04f-4b1a-be26-388c0a99da4c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:21.020819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5d61051b-b04f-4b1a-be26-388c0a99da4c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:21.021998 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5d61051b-b04f-4b1a-be26-388c0a99da4c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.157255 May 13 17:32:21.022560 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 458/901] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:20 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:21.141777 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-8e8b04da-e5e4-4c68-898d-bc34617336c4 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:21.142477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-8e8b04da-e5e4-4c68-898d-bc34617336c4 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:21.148470 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8e8b04da-e5e4-4c68-898d-bc34617336c4 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:21.148919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8e8b04da-e5e4-4c68-898d-bc34617336c4 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:21.149698 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8e8b04da-e5e4-4c68-898d-bc34617336c4 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:21.150116 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8e8b04da-e5e4-4c68-898d-bc34617336c4 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:21.278463 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-8e8b04da-e5e4-4c68-898d-bc34617336c4 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:21.286510 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-8e8b04da-e5e4-4c68-898d-bc34617336c4 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1318 microversion: 2.1 time: 0.149526 May 13 17:32:21.287086 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 444/902] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:32:21 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:32:22.039328 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fa8b25ef-eb00-4353-9205-fa86cb44eb35 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:22.039956 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fa8b25ef-eb00-4353-9205-fa86cb44eb35 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:22.046765 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fa8b25ef-eb00-4353-9205-fa86cb44eb35 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:22.047227 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fa8b25ef-eb00-4353-9205-fa86cb44eb35 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:22.047984 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fa8b25ef-eb00-4353-9205-fa86cb44eb35 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:22.048420 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fa8b25ef-eb00-4353-9205-fa86cb44eb35 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:22.190096 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fa8b25ef-eb00-4353-9205-fa86cb44eb35 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:22.198238 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fa8b25ef-eb00-4353-9205-fa86cb44eb35 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:22.199765 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fa8b25ef-eb00-4353-9205-fa86cb44eb35 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:22.206734 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fa8b25ef-eb00-4353-9205-fa86cb44eb35 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.165441 May 13 17:32:22.206734 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 459/903] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:22 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:22.302998 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-dcfdbfbb-9ea0-4cb8-a62a-9f2ff1045284 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:22.303576 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-dcfdbfbb-9ea0-4cb8-a62a-9f2ff1045284 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:22.309746 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dcfdbfbb-9ea0-4cb8-a62a-9f2ff1045284 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:22.310189 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dcfdbfbb-9ea0-4cb8-a62a-9f2ff1045284 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:22.310942 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dcfdbfbb-9ea0-4cb8-a62a-9f2ff1045284 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:22.311472 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dcfdbfbb-9ea0-4cb8-a62a-9f2ff1045284 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:22.433751 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-dcfdbfbb-9ea0-4cb8-a62a-9f2ff1045284 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:22.441321 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-dcfdbfbb-9ea0-4cb8-a62a-9f2ff1045284 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1318 microversion: 2.1 time: 0.142150 May 13 17:32:22.441886 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 445/904] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:32:22 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1318 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:32:23.221196 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a86e058f-b4c4-4ff3-98de-611bc8f35eca tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:23.222040 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a86e058f-b4c4-4ff3-98de-611bc8f35eca tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:23.229207 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a86e058f-b4c4-4ff3-98de-611bc8f35eca tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:23.229381 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a86e058f-b4c4-4ff3-98de-611bc8f35eca tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:23.230198 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a86e058f-b4c4-4ff3-98de-611bc8f35eca tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:23.230631 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a86e058f-b4c4-4ff3-98de-611bc8f35eca tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:23.376686 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a86e058f-b4c4-4ff3-98de-611bc8f35eca tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:23.385679 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a86e058f-b4c4-4ff3-98de-611bc8f35eca tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:23.387329 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a86e058f-b4c4-4ff3-98de-611bc8f35eca tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:23.388740 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a86e058f-b4c4-4ff3-98de-611bc8f35eca tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.172257 May 13 17:32:23.389286 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 460/905] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:23 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:23.457949 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-bb20e97a-b4ef-4698-8091-859dab44728c tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:23.458617 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-bb20e97a-b4ef-4698-8091-859dab44728c tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:23.465036 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bb20e97a-b4ef-4698-8091-859dab44728c tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:23.465488 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bb20e97a-b4ef-4698-8091-859dab44728c tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:23.466268 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bb20e97a-b4ef-4698-8091-859dab44728c tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:23.467318 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bb20e97a-b4ef-4698-8091-859dab44728c tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:23.607463 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-bb20e97a-b4ef-4698-8091-859dab44728c tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:23.615161 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-bb20e97a-b4ef-4698-8091-859dab44728c tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1508 microversion: 2.1 time: 0.161100 May 13 17:32:23.615735 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 446/906] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:32:23 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:32:23.631430 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a2d342b9-e075-4b07-8bd4-37d5ab7aac43 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78ac2834-f8a8-4f11-aa9c-42d0f501a43b", "device": "/dev/sdb"}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:32:23.633087 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a2d342b9-e075-4b07-8bd4-37d5ab7aac43 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:23.638874 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a2d342b9-e075-4b07-8bd4-37d5ab7aac43 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:23.639363 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a2d342b9-e075-4b07-8bd4-37d5ab7aac43 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:23.640782 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a2d342b9-e075-4b07-8bd4-37d5ab7aac43 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:23.641224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a2d342b9-e075-4b07-8bd4-37d5ab7aac43 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:24.407315 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-0a936f37-830d-4d9d-92f3-4a94c792890b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:24.407929 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-0a936f37-830d-4d9d-92f3-4a94c792890b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:24.413942 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0a936f37-830d-4d9d-92f3-4a94c792890b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:24.414391 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0a936f37-830d-4d9d-92f3-4a94c792890b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:24.415183 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0a936f37-830d-4d9d-92f3-4a94c792890b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:24.415628 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0a936f37-830d-4d9d-92f3-4a94c792890b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:24.541373 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0a936f37-830d-4d9d-92f3-4a94c792890b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:24.550072 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0a936f37-830d-4d9d-92f3-4a94c792890b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:24.551698 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0a936f37-830d-4d9d-92f3-4a94c792890b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:24.552946 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-0a936f37-830d-4d9d-92f3-4a94c792890b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.149585 May 13 17:32:24.554283 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 447/907] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:24 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:32:24.782379 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a2d342b9-e075-4b07-8bd4-37d5ab7aac43 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "POST /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.154790 May 13 17:32:24.783007 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 461/908] 10.222.0.64 () {60 vars in 1322 bytes} [Fri May 13 17:32:23 2022] POST /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2/os-volume_attachments => generated 194 bytes in 1156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:32:25.087616 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-4bcd1d20-0344-4a6f-a57f-a6313ab8adee req-4ed346d3-0405-4dc8-b93b-5cfd4ded4e3a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65fdbf1a-f080-4d79-b3f3-c465e5a81c67", "name": "network-vif-plugged", "status": "completed", "tag": "41053781-3367-4859-b7f7-eb83af021a82"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:32:25.096401 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-4bcd1d20-0344-4a6f-a57f-a6313ab8adee req-4ed346d3-0405-4dc8-b93b-5cfd4ded4e3a service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:25.096851 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-4bcd1d20-0344-4a6f-a57f-a6313ab8adee req-4ed346d3-0405-4dc8-b93b-5cfd4ded4e3a service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:25.107944 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-4bcd1d20-0344-4a6f-a57f-a6313ab8adee req-4ed346d3-0405-4dc8-b93b-5cfd4ded4e3a service nova] Creating event network-vif-plugged:41053781-3367-4859-b7f7-eb83af021a82 for instance 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 on hv-cinder-84178 May 13 17:32:25.112882 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-4bcd1d20-0344-4a6f-a57f-a6313ab8adee req-4ed346d3-0405-4dc8-b93b-5cfd4ded4e3a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086320 May 13 17:32:25.115830 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 448/909] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:32:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:32:25.572774 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-df982011-2705-4737-907d-0dcf4846bc85 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:25.573381 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-df982011-2705-4737-907d-0dcf4846bc85 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:25.579824 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-df982011-2705-4737-907d-0dcf4846bc85 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:25.580341 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-df982011-2705-4737-907d-0dcf4846bc85 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:25.581119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-df982011-2705-4737-907d-0dcf4846bc85 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:25.581559 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-df982011-2705-4737-907d-0dcf4846bc85 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:25.707664 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-df982011-2705-4737-907d-0dcf4846bc85 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:25.715848 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-df982011-2705-4737-907d-0dcf4846bc85 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:25.717387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-df982011-2705-4737-907d-0dcf4846bc85 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:25.719039 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-df982011-2705-4737-907d-0dcf4846bc85 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.151019 May 13 17:32:25.719628 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 462/910] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:25 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:26.738719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-799397f9-55c7-4159-bed6-79de4855272d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:26.739440 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-799397f9-55c7-4159-bed6-79de4855272d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:26.745487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-799397f9-55c7-4159-bed6-79de4855272d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:26.745935 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-799397f9-55c7-4159-bed6-79de4855272d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:26.746781 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-799397f9-55c7-4159-bed6-79de4855272d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:26.747250 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-799397f9-55c7-4159-bed6-79de4855272d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:26.887780 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-799397f9-55c7-4159-bed6-79de4855272d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:26.896740 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-799397f9-55c7-4159-bed6-79de4855272d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:26.897956 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-799397f9-55c7-4159-bed6-79de4855272d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:26.899148 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-799397f9-55c7-4159-bed6-79de4855272d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.165785 May 13 17:32:26.899724 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 449/911] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:26 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:27.917843 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-85b4cc5e-d2e2-4f62-84a7-0538cd3e840a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:27.918428 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-85b4cc5e-d2e2-4f62-84a7-0538cd3e840a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:27.926903 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-85b4cc5e-d2e2-4f62-84a7-0538cd3e840a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:27.927396 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-85b4cc5e-d2e2-4f62-84a7-0538cd3e840a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:27.928401 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-85b4cc5e-d2e2-4f62-84a7-0538cd3e840a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:27.929183 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-85b4cc5e-d2e2-4f62-84a7-0538cd3e840a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:28.063372 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-85b4cc5e-d2e2-4f62-84a7-0538cd3e840a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:28.071462 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-85b4cc5e-d2e2-4f62-84a7-0538cd3e840a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:28.072931 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-85b4cc5e-d2e2-4f62-84a7-0538cd3e840a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:28.074068 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-85b4cc5e-d2e2-4f62-84a7-0538cd3e840a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.160162 May 13 17:32:28.074624 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 463/912] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:27 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:29.090977 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-668d5029-68ff-4966-bde8-f98b28086ed0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:29.091644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-668d5029-68ff-4966-bde8-f98b28086ed0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:29.098780 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-668d5029-68ff-4966-bde8-f98b28086ed0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:29.099269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-668d5029-68ff-4966-bde8-f98b28086ed0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:29.100046 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-668d5029-68ff-4966-bde8-f98b28086ed0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:29.100483 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-668d5029-68ff-4966-bde8-f98b28086ed0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:29.223743 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-668d5029-68ff-4966-bde8-f98b28086ed0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:29.231874 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-668d5029-68ff-4966-bde8-f98b28086ed0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:29.233392 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-668d5029-68ff-4966-bde8-f98b28086ed0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:29.234816 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-668d5029-68ff-4966-bde8-f98b28086ed0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.147575 May 13 17:32:29.247638 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 450/913] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:29 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:30.265796 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fea57086-35c0-480f-9763-9c113c213087 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:30.266316 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fea57086-35c0-480f-9763-9c113c213087 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:30.272531 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fea57086-35c0-480f-9763-9c113c213087 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:30.272977 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fea57086-35c0-480f-9763-9c113c213087 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:30.273729 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fea57086-35c0-480f-9763-9c113c213087 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:30.274158 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fea57086-35c0-480f-9763-9c113c213087 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:30.405201 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fea57086-35c0-480f-9763-9c113c213087 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:30.413939 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fea57086-35c0-480f-9763-9c113c213087 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:30.415436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fea57086-35c0-480f-9763-9c113c213087 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:30.416593 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fea57086-35c0-480f-9763-9c113c213087 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.154816 May 13 17:32:30.417152 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 464/914] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:30 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:31.435731 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b0a1f288-8218-4a86-8187-e17d96db64c5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:31.436334 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b0a1f288-8218-4a86-8187-e17d96db64c5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:31.442794 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b0a1f288-8218-4a86-8187-e17d96db64c5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:31.443268 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b0a1f288-8218-4a86-8187-e17d96db64c5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:31.444023 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b0a1f288-8218-4a86-8187-e17d96db64c5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:31.444452 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b0a1f288-8218-4a86-8187-e17d96db64c5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:31.569462 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b0a1f288-8218-4a86-8187-e17d96db64c5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:31.578167 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b0a1f288-8218-4a86-8187-e17d96db64c5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:31.579697 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b0a1f288-8218-4a86-8187-e17d96db64c5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:31.580858 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b0a1f288-8218-4a86-8187-e17d96db64c5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.149974 May 13 17:32:31.581424 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 451/915] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:31 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:32.603773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e3090b4d-18e0-42d4-b1c0-dbb3561495d2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:32.604374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e3090b4d-18e0-42d4-b1c0-dbb3561495d2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:32.610700 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e3090b4d-18e0-42d4-b1c0-dbb3561495d2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:32.611151 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e3090b4d-18e0-42d4-b1c0-dbb3561495d2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:32.611928 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e3090b4d-18e0-42d4-b1c0-dbb3561495d2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:32.612353 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e3090b4d-18e0-42d4-b1c0-dbb3561495d2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:32.740972 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e3090b4d-18e0-42d4-b1c0-dbb3561495d2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:32.749237 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e3090b4d-18e0-42d4-b1c0-dbb3561495d2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:32.750770 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e3090b4d-18e0-42d4-b1c0-dbb3561495d2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:32.751899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e3090b4d-18e0-42d4-b1c0-dbb3561495d2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.152121 May 13 17:32:32.752454 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 465/916] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:32 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:33.769801 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-41bf01fd-c085-4f01-9b8d-042ddc35a4b4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:33.771111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-41bf01fd-c085-4f01-9b8d-042ddc35a4b4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:33.777744 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-41bf01fd-c085-4f01-9b8d-042ddc35a4b4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:33.778210 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-41bf01fd-c085-4f01-9b8d-042ddc35a4b4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:33.778995 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-41bf01fd-c085-4f01-9b8d-042ddc35a4b4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:33.779992 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-41bf01fd-c085-4f01-9b8d-042ddc35a4b4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:33.912505 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-41bf01fd-c085-4f01-9b8d-042ddc35a4b4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:33.921052 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-41bf01fd-c085-4f01-9b8d-042ddc35a4b4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:33.923312 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-41bf01fd-c085-4f01-9b8d-042ddc35a4b4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:33.924501 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-41bf01fd-c085-4f01-9b8d-042ddc35a4b4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1808 microversion: 2.20 time: 0.158678 May 13 17:32:33.925090 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 452/917] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:33 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:34.943510 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2a5cec16-9105-43b9-b76a-e5d827005ab5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:34.944113 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2a5cec16-9105-43b9-b76a-e5d827005ab5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:34.950503 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2a5cec16-9105-43b9-b76a-e5d827005ab5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:34.950930 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2a5cec16-9105-43b9-b76a-e5d827005ab5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:34.951734 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2a5cec16-9105-43b9-b76a-e5d827005ab5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:34.952175 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2a5cec16-9105-43b9-b76a-e5d827005ab5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:35.078061 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2a5cec16-9105-43b9-b76a-e5d827005ab5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:35.086183 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2a5cec16-9105-43b9-b76a-e5d827005ab5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:35.087715 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2a5cec16-9105-43b9-b76a-e5d827005ab5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:35.088873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2a5cec16-9105-43b9-b76a-e5d827005ab5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1795 microversion: 2.20 time: 0.149360 May 13 17:32:35.089431 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 466/918] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:32:34 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1795 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:32:50.978840 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-42fe9b52-0229-4ce6-8d1e-ed60be6ed621 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:50.979377 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-42fe9b52-0229-4ce6-8d1e-ed60be6ed621 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:50.985696 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-42fe9b52-0229-4ce6-8d1e-ed60be6ed621 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:50.986149 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-42fe9b52-0229-4ce6-8d1e-ed60be6ed621 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:50.986918 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-42fe9b52-0229-4ce6-8d1e-ed60be6ed621 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:50.987504 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-42fe9b52-0229-4ce6-8d1e-ed60be6ed621 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:51.107039 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.objects.instance [None req-42fe9b52-0229-4ce6-8d1e-ed60be6ed621 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lazy-loading 'services' on Instance uuid 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 {{(pid=117492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:32:51.380357 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-42fe9b52-0229-4ce6-8d1e-ed60be6ed621 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "DELETE /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2/os-volume_attachments/78ac2834-f8a8-4f11-aa9c-42d0f501a43b" status: 202 len: 0 microversion: 2.1 time: 0.405221 May 13 17:32:51.381005 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 453/919] 10.222.0.64 () {58 vars in 1415 bytes} [Fri May 13 17:32:50 2022] DELETE /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2/os-volume_attachments/78ac2834-f8a8-4f11-aa9c-42d0f501a43b => generated 0 bytes in 407 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:32:53.550059 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-958cb63f-a063-4166-93b5-0ba234dc1d58 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:53.550576 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-958cb63f-a063-4166-93b5-0ba234dc1d58 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:53.557455 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-958cb63f-a063-4166-93b5-0ba234dc1d58 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:53.557911 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-958cb63f-a063-4166-93b5-0ba234dc1d58 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:53.558714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-958cb63f-a063-4166-93b5-0ba234dc1d58 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:53.559184 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-958cb63f-a063-4166-93b5-0ba234dc1d58 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:53.583370 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-958cb63f-a063-4166-93b5-0ba234dc1d58 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Going to try to terminate instance {{(pid=117493) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 17:32:53.841143 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-958cb63f-a063-4166-93b5-0ba234dc1d58 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "DELETE /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 204 len: 0 microversion: 2.1 time: 0.294555 May 13 17:32:53.841654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 467/920] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:32:53 2022] DELETE /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 17:32:53.851489 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6c1be557-7db3-4bce-b9ba-9b6f0e55b2b0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:53.852189 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6c1be557-7db3-4bce-b9ba-9b6f0e55b2b0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:53.858327 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6c1be557-7db3-4bce-b9ba-9b6f0e55b2b0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:53.858771 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6c1be557-7db3-4bce-b9ba-9b6f0e55b2b0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:53.859564 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6c1be557-7db3-4bce-b9ba-9b6f0e55b2b0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:53.859996 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6c1be557-7db3-4bce-b9ba-9b6f0e55b2b0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:53.985257 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6c1be557-7db3-4bce-b9ba-9b6f0e55b2b0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:53.993157 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6c1be557-7db3-4bce-b9ba-9b6f0e55b2b0 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1514 microversion: 2.1 time: 0.146499 May 13 17:32:53.993738 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 454/921] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:32:53 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:32:55.011425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b4b239a7-4819-4afa-aaa8-4800047a701f tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:55.012130 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b4b239a7-4819-4afa-aaa8-4800047a701f tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:55.018562 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b4b239a7-4819-4afa-aaa8-4800047a701f tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:55.019008 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b4b239a7-4819-4afa-aaa8-4800047a701f tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:55.019798 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b4b239a7-4819-4afa-aaa8-4800047a701f tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:55.020234 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b4b239a7-4819-4afa-aaa8-4800047a701f tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:55.376049 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b4b239a7-4819-4afa-aaa8-4800047a701f tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:55.384038 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b4b239a7-4819-4afa-aaa8-4800047a701f tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1514 microversion: 2.1 time: 0.376782 May 13 17:32:55.385052 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 468/922] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:32:55 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1514 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:32:56.400825 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3762c101-bc9e-4824-9d9e-180c3e58b884 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:56.401439 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3762c101-bc9e-4824-9d9e-180c3e58b884 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:56.407903 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3762c101-bc9e-4824-9d9e-180c3e58b884 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:56.408358 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3762c101-bc9e-4824-9d9e-180c3e58b884 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:56.409122 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3762c101-bc9e-4824-9d9e-180c3e58b884 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:56.409570 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3762c101-bc9e-4824-9d9e-180c3e58b884 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:56.704804 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3762c101-bc9e-4824-9d9e-180c3e58b884 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:56.712863 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3762c101-bc9e-4824-9d9e-180c3e58b884 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1514 microversion: 2.1 time: 0.315806 May 13 17:32:56.713541 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 455/923] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:32:56 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1514 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:32:56.953527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-e550a63c-3187-48f2-8418-b002c9e6ed26 req-0e9c9d49-dcb6-4cec-84c4-52afe56fe5d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43b2b263-fb7a-4fe9-abaa-2df5d8c901c2", "name": "network-vif-deleted", "tag": "184e5bd1-70c3-49ee-b517-f4be3467d55c"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:32:56.962844 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-e550a63c-3187-48f2-8418-b002c9e6ed26 req-0e9c9d49-dcb6-4cec-84c4-52afe56fe5d2 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:56.963402 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-e550a63c-3187-48f2-8418-b002c9e6ed26 req-0e9c9d49-dcb6-4cec-84c4-52afe56fe5d2 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:56.974703 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-e550a63c-3187-48f2-8418-b002c9e6ed26 req-0e9c9d49-dcb6-4cec-84c4-52afe56fe5d2 service nova] Creating event network-vif-deleted:184e5bd1-70c3-49ee-b517-f4be3467d55c for instance 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 on hv-cinder-84178 May 13 17:32:56.979880 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-e550a63c-3187-48f2-8418-b002c9e6ed26 req-0e9c9d49-dcb6-4cec-84c4-52afe56fe5d2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030224 May 13 17:32:56.982058 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 469/924] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:32:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:32:57.730205 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d60a27c8-44fb-4602-997f-cfd026aa6000 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:57.730808 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d60a27c8-44fb-4602-997f-cfd026aa6000 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:57.736989 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d60a27c8-44fb-4602-997f-cfd026aa6000 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:57.741096 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d60a27c8-44fb-4602-997f-cfd026aa6000 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:57.741096 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d60a27c8-44fb-4602-997f-cfd026aa6000 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:57.741096 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d60a27c8-44fb-4602-997f-cfd026aa6000 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:57.768744 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d60a27c8-44fb-4602-997f-cfd026aa6000 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:57.769193 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d60a27c8-44fb-4602-997f-cfd026aa6000 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:57.769639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.objects.instance [None req-d60a27c8-44fb-4602-997f-cfd026aa6000 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lazy-loading 'fault' on Instance uuid 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 {{(pid=117492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:32:57.815836 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d60a27c8-44fb-4602-997f-cfd026aa6000 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '00983ee7706f43d4b3f7d0f178c0e924', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e9f5f08db8cb40f0857115f4c9aadaf7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:32:57.823142 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d60a27c8-44fb-4602-997f-cfd026aa6000 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 200 len: 1308 microversion: 2.1 time: 0.096619 May 13 17:32:57.823729 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 456/925] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:32:57 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 1308 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:32:58.841140 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e31029f4-dc1d-46ba-8905-7f7f52c3da19 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:32:58.841837 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e31029f4-dc1d-46ba-8905-7f7f52c3da19 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] [instance: 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:32:58.848342 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e31029f4-dc1d-46ba-8905-7f7f52c3da19 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:58.849062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e31029f4-dc1d-46ba-8905-7f7f52c3da19 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:58.850398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e31029f4-dc1d-46ba-8905-7f7f52c3da19 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:32:58.850838 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e31029f4-dc1d-46ba-8905-7f7f52c3da19 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:32:58.863642 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-e31029f4-dc1d-46ba-8905-7f7f52c3da19 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] HTTP exception thrown: Instance 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 could not be found. May 13 17:32:58.865224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e31029f4-dc1d-46ba-8905-7f7f52c3da19 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Request method failure captured: May 13 17:32:58.865224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 HTTP/1.1 May 13 17:32:58.865224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:32:58.865224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:32:58.865224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:32:58.865224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:32:58.865224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:32:58.865224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:32:58.865224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:32:58.865224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:32:58.865224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpWOudamhPa3Any_QypZf3CnsKfBmZey3zDDDHOS16cHaD9EMBA78ECV0h0Vf0dmb5PYxYkNz4r3mnuQexmMegY7Io4KOlQnq1ltHsGnVtnhGMH69qRyESinSpHVHubSVaO-TNYhyfYazJxy5V17cLs7bf3w1uGUZzV-l6F31VHZmd0 May 13 17:32:58.865224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:32:58.865224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:32:58.865224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:32:58.865224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:32:58.865224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:32:58.865224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:32:58.865224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: e9f5f08db8cb40f0857115f4c9aadaf7 May 13 17:32:58.865224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-VolumesSnapshotTestJSON-25963212 May 13 17:32:58.865224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:32:58.865224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:32:58.866726 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e9f5f08db8cb40f0857115f4c9aadaf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e9f5f08db8cb40f0857115f4c9aadaf7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e9f5f08db8cb40f0857115f4c9aadaf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e9f5f08db8cb40f0857115f4c9aadaf7"}]}] May 13 17:32:58.866726 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-VolumesSnapshotTestJSON-25963212 May 13 17:32:58.866726 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: e9f5f08db8cb40f0857115f4c9aadaf7 May 13 17:32:58.866726 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-25963212 May 13 17:32:58.866726 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-VolumesSnapshotTestJSON-25963212-project May 13 17:32:58.866726 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:32:58.866726 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:32:58.866726 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: 00983ee7706f43d4b3f7d0f178c0e924 May 13 17:32:58.866726 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-VolumesSnapshotTestJSON-25963212-project May 13 17:32:58.866726 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: > May 13 17:32:58.866726 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Instance 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 could not be found. May 13 17:32:58.866726 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '43b2b263-fb7a-4fe9-abaa-2df5d8c901c2'} May 13 17:32:58.867654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:32:58.867654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:32:58.867654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:32:58.867654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:32:58.867654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:32:58.867654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:32:58.867654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:32:58.867654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:32:58.867654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:32:58.867654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:32:58.867654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 could not be found. May 13 17:32:58.867654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:32:58.867654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:32:58.867654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:32:58.867654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:32:58.867654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:32:58.867654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:32:58.867654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:32:58.867654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:32:58.867654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:32:58.869152 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:32:58.869152 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:32:58.869152 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:32:58.869152 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:32:58.869152 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:32:58.869152 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:32:58.869152 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:32:58.869152 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 could not be found. May 13 17:32:58.869152 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:32:58.869152 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:32:58.869152 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:32:58.869152 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:32:58.869152 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:32:58.869152 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:32:58.869152 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:32:58.869152 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:32:58.869152 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 could not be found. May 13 17:32:58.869152 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:32:58.870624 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e31029f4-dc1d-46ba-8905-7f7f52c3da19 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] Returning 404 to user: Instance 43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:32:58.870624 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e31029f4-dc1d-46ba-8905-7f7f52c3da19 tempest-VolumesSnapshotTestJSON-25963212 tempest-VolumesSnapshotTestJSON-25963212-project] 10.222.0.64 "GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2" status: 404 len: 111 microversion: 2.1 time: 0.029658 May 13 17:32:58.870624 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 470/926] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:32:58 2022] GET /compute/v2.1/servers/43b2b263-fb7a-4fe9-abaa-2df5d8c901c2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:33:07.676801 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-61b4ef1b-f18a-4edf-a5dd-441a7351bd6a tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:33:07.676801 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-61b4ef1b-f18a-4edf-a5dd-441a7351bd6a tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:07.676801 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-61b4ef1b-f18a-4edf-a5dd-441a7351bd6a tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:07.676801 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-61b4ef1b-f18a-4edf-a5dd-441a7351bd6a tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:07.677517 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-61b4ef1b-f18a-4edf-a5dd-441a7351bd6a tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:07.677517 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-61b4ef1b-f18a-4edf-a5dd-441a7351bd6a tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:07.887528 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-61b4ef1b-f18a-4edf-a5dd-441a7351bd6a tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "POST /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98/action" status: 202 len: 0 microversion: 2.1 time: 0.222882 May 13 17:33:07.889346 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 457/927] 10.222.0.64 () {60 vars in 1277 bytes} [Fri May 13 17:33:07 2022] POST /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:33:07.896077 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-eb25afb4-b7e1-41a7-9c27-34bd2b6076ae tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:07.896792 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-eb25afb4-b7e1-41a7-9c27-34bd2b6076ae tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:07.903825 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eb25afb4-b7e1-41a7-9c27-34bd2b6076ae tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:07.904300 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eb25afb4-b7e1-41a7-9c27-34bd2b6076ae tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:07.905181 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eb25afb4-b7e1-41a7-9c27-34bd2b6076ae tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:07.905487 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eb25afb4-b7e1-41a7-9c27-34bd2b6076ae tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:08.054506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-eb25afb4-b7e1-41a7-9c27-34bd2b6076ae tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:08.062408 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-eb25afb4-b7e1-41a7-9c27-34bd2b6076ae tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1751 microversion: 2.1 time: 0.170103 May 13 17:33:08.063004 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 471/928] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:07 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:09.080595 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-ace699d2-0da7-491c-aa25-8157b971c1f9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:09.081289 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-ace699d2-0da7-491c-aa25-8157b971c1f9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:09.087879 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ace699d2-0da7-491c-aa25-8157b971c1f9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:09.088319 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ace699d2-0da7-491c-aa25-8157b971c1f9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:09.089077 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ace699d2-0da7-491c-aa25-8157b971c1f9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:09.089506 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ace699d2-0da7-491c-aa25-8157b971c1f9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:09.234425 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-ace699d2-0da7-491c-aa25-8157b971c1f9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:09.242985 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-ace699d2-0da7-491c-aa25-8157b971c1f9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1756 microversion: 2.1 time: 0.167130 May 13 17:33:09.243600 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 458/929] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:09 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:10.261057 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5e30916e-70ac-4553-9a23-8d8f5f5fc324 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:10.261652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5e30916e-70ac-4553-9a23-8d8f5f5fc324 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:10.267463 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5e30916e-70ac-4553-9a23-8d8f5f5fc324 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:10.273903 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5e30916e-70ac-4553-9a23-8d8f5f5fc324 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:10.273903 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5e30916e-70ac-4553-9a23-8d8f5f5fc324 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:10.273903 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5e30916e-70ac-4553-9a23-8d8f5f5fc324 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:10.414462 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5e30916e-70ac-4553-9a23-8d8f5f5fc324 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:10.423370 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5e30916e-70ac-4553-9a23-8d8f5f5fc324 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1756 microversion: 2.1 time: 0.166203 May 13 17:33:10.423937 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 472/930] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:10 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:11.440551 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-60e9b758-6919-40cb-9846-0404ac37b260 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:11.441165 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-60e9b758-6919-40cb-9846-0404ac37b260 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:11.448031 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-60e9b758-6919-40cb-9846-0404ac37b260 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:11.448490 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-60e9b758-6919-40cb-9846-0404ac37b260 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:11.449261 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-60e9b758-6919-40cb-9846-0404ac37b260 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:11.449699 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-60e9b758-6919-40cb-9846-0404ac37b260 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:11.591346 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-60e9b758-6919-40cb-9846-0404ac37b260 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:11.599408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-60e9b758-6919-40cb-9846-0404ac37b260 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1756 microversion: 2.1 time: 0.162463 May 13 17:33:11.600546 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 459/931] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:11 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:12.617400 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ba9285f4-f2a9-494c-bfc0-629a5573b5ff tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:12.617999 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ba9285f4-f2a9-494c-bfc0-629a5573b5ff tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:12.624221 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ba9285f4-f2a9-494c-bfc0-629a5573b5ff tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:12.624673 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ba9285f4-f2a9-494c-bfc0-629a5573b5ff tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:12.625431 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ba9285f4-f2a9-494c-bfc0-629a5573b5ff tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:12.625859 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ba9285f4-f2a9-494c-bfc0-629a5573b5ff tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:12.767646 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ba9285f4-f2a9-494c-bfc0-629a5573b5ff tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:12.776238 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ba9285f4-f2a9-494c-bfc0-629a5573b5ff tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1756 microversion: 2.1 time: 0.163054 May 13 17:33:12.776752 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 473/932] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:12 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:13.793397 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-93cb418a-f78d-4277-8172-4b8d18a3e111 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:13.794233 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-93cb418a-f78d-4277-8172-4b8d18a3e111 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:13.800515 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-93cb418a-f78d-4277-8172-4b8d18a3e111 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:13.800960 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-93cb418a-f78d-4277-8172-4b8d18a3e111 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:13.802009 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-93cb418a-f78d-4277-8172-4b8d18a3e111 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:13.802445 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-93cb418a-f78d-4277-8172-4b8d18a3e111 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:13.941642 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-93cb418a-f78d-4277-8172-4b8d18a3e111 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:13.949924 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-93cb418a-f78d-4277-8172-4b8d18a3e111 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1756 microversion: 2.1 time: 0.160334 May 13 17:33:13.950488 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 460/933] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:13 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:14.967028 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f0e99427-876b-4664-9ad7-9e3ba58d9041 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:14.967667 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f0e99427-876b-4664-9ad7-9e3ba58d9041 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:14.974249 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f0e99427-876b-4664-9ad7-9e3ba58d9041 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:14.974700 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f0e99427-876b-4664-9ad7-9e3ba58d9041 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:14.976106 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f0e99427-876b-4664-9ad7-9e3ba58d9041 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:14.976548 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f0e99427-876b-4664-9ad7-9e3ba58d9041 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:15.112772 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f0e99427-876b-4664-9ad7-9e3ba58d9041 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:15.120514 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f0e99427-876b-4664-9ad7-9e3ba58d9041 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1756 microversion: 2.1 time: 0.157288 May 13 17:33:15.121091 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 474/934] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:14 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:16.137129 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-eba02b48-beda-4d23-9fd4-74de257ceb05 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:16.137737 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-eba02b48-beda-4d23-9fd4-74de257ceb05 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:16.144109 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-eba02b48-beda-4d23-9fd4-74de257ceb05 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:16.144561 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-eba02b48-beda-4d23-9fd4-74de257ceb05 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:16.145334 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-eba02b48-beda-4d23-9fd4-74de257ceb05 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:16.145773 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-eba02b48-beda-4d23-9fd4-74de257ceb05 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:16.289212 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-eba02b48-beda-4d23-9fd4-74de257ceb05 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:16.296958 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-eba02b48-beda-4d23-9fd4-74de257ceb05 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1756 microversion: 2.1 time: 0.163683 May 13 17:33:16.297547 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 461/935] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:16 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:17.317542 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-269851e7-b9dd-4d28-ac7a-75d138143e75 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:17.318051 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-269851e7-b9dd-4d28-ac7a-75d138143e75 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:17.324894 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-269851e7-b9dd-4d28-ac7a-75d138143e75 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:17.325338 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-269851e7-b9dd-4d28-ac7a-75d138143e75 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:17.326089 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-269851e7-b9dd-4d28-ac7a-75d138143e75 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:17.326521 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-269851e7-b9dd-4d28-ac7a-75d138143e75 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:17.462863 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-269851e7-b9dd-4d28-ac7a-75d138143e75 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:17.470589 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-269851e7-b9dd-4d28-ac7a-75d138143e75 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1756 microversion: 2.1 time: 0.156968 May 13 17:33:17.471172 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 475/936] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:17 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1756 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:18.488420 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6fee7085-61e2-422a-a44e-f4ed9fd6e644 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:18.489040 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6fee7085-61e2-422a-a44e-f4ed9fd6e644 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:18.496088 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6fee7085-61e2-422a-a44e-f4ed9fd6e644 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:18.496532 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6fee7085-61e2-422a-a44e-f4ed9fd6e644 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:18.497292 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6fee7085-61e2-422a-a44e-f4ed9fd6e644 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:18.497722 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6fee7085-61e2-422a-a44e-f4ed9fd6e644 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:18.643501 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6fee7085-61e2-422a-a44e-f4ed9fd6e644 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:18.651456 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6fee7085-61e2-422a-a44e-f4ed9fd6e644 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1756 microversion: 2.1 time: 0.167002 May 13 17:33:18.652023 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 462/937] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:18 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:19.668756 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d447a3c8-04a3-405f-bc5e-cb16fffb534d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:19.669521 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d447a3c8-04a3-405f-bc5e-cb16fffb534d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:19.676055 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d447a3c8-04a3-405f-bc5e-cb16fffb534d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:19.676506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d447a3c8-04a3-405f-bc5e-cb16fffb534d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:19.677271 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d447a3c8-04a3-405f-bc5e-cb16fffb534d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:19.677706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d447a3c8-04a3-405f-bc5e-cb16fffb534d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:19.823740 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d447a3c8-04a3-405f-bc5e-cb16fffb534d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:19.831512 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d447a3c8-04a3-405f-bc5e-cb16fffb534d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1756 microversion: 2.1 time: 0.166612 May 13 17:33:19.832087 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 476/938] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:19 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:33:20.848950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1f034e77-9cc5-463e-a936-96b60d87072f tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:20.849856 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-1f034e77-9cc5-463e-a936-96b60d87072f tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:20.856255 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1f034e77-9cc5-463e-a936-96b60d87072f tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:20.856730 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1f034e77-9cc5-463e-a936-96b60d87072f tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:20.857464 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1f034e77-9cc5-463e-a936-96b60d87072f tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:20.857901 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1f034e77-9cc5-463e-a936-96b60d87072f tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:20.999537 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-1f034e77-9cc5-463e-a936-96b60d87072f tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:21.008009 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-1f034e77-9cc5-463e-a936-96b60d87072f tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1756 microversion: 2.1 time: 0.162365 May 13 17:33:21.008575 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 463/939] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:20 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1756 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:22.025351 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-347448f6-c23c-4f1b-b02a-46ee8a6ddfe6 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:22.026000 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-347448f6-c23c-4f1b-b02a-46ee8a6ddfe6 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:22.032824 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-347448f6-c23c-4f1b-b02a-46ee8a6ddfe6 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:22.033278 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-347448f6-c23c-4f1b-b02a-46ee8a6ddfe6 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:22.034051 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-347448f6-c23c-4f1b-b02a-46ee8a6ddfe6 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:22.034495 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-347448f6-c23c-4f1b-b02a-46ee8a6ddfe6 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:22.178824 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-347448f6-c23c-4f1b-b02a-46ee8a6ddfe6 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:22.187361 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-347448f6-c23c-4f1b-b02a-46ee8a6ddfe6 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1756 microversion: 2.1 time: 0.166056 May 13 17:33:22.187944 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 477/940] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:22 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:23.204171 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-9ee0fe0b-d059-46ea-9671-f734c8dae30d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:23.204788 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-9ee0fe0b-d059-46ea-9671-f734c8dae30d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:23.211568 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9ee0fe0b-d059-46ea-9671-f734c8dae30d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:23.212027 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9ee0fe0b-d059-46ea-9671-f734c8dae30d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:23.212798 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9ee0fe0b-d059-46ea-9671-f734c8dae30d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:23.213237 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9ee0fe0b-d059-46ea-9671-f734c8dae30d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:23.355318 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-9ee0fe0b-d059-46ea-9671-f734c8dae30d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:23.363959 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-9ee0fe0b-d059-46ea-9671-f734c8dae30d tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1756 microversion: 2.1 time: 0.163426 May 13 17:33:23.364716 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 464/941] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:23 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:24.381256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ad2f8d87-2961-4b8f-97dd-4bbab145aa4c tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:24.381861 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ad2f8d87-2961-4b8f-97dd-4bbab145aa4c tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:24.388797 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ad2f8d87-2961-4b8f-97dd-4bbab145aa4c tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:24.389250 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ad2f8d87-2961-4b8f-97dd-4bbab145aa4c tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:24.390010 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ad2f8d87-2961-4b8f-97dd-4bbab145aa4c tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:24.390444 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ad2f8d87-2961-4b8f-97dd-4bbab145aa4c tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:24.533163 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ad2f8d87-2961-4b8f-97dd-4bbab145aa4c tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:24.541626 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ad2f8d87-2961-4b8f-97dd-4bbab145aa4c tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1756 microversion: 2.1 time: 0.164187 May 13 17:33:24.542199 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 478/942] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:24 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:25.110949 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-0c590445-2415-45b7-b53d-2442785382ad tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:25.111478 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-0c590445-2415-45b7-b53d-2442785382ad tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:25.118061 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0c590445-2415-45b7-b53d-2442785382ad tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:25.118508 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0c590445-2415-45b7-b53d-2442785382ad tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:25.119317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0c590445-2415-45b7-b53d-2442785382ad tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:25.119752 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0c590445-2415-45b7-b53d-2442785382ad tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:25.198804 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.objects.instance [None req-0c590445-2415-45b7-b53d-2442785382ad tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lazy-loading 'services' on Instance uuid 9a72fdd8-ca24-4ae1-b007-7e22f411ad48 {{(pid=117492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:33:25.380024 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-0c590445-2415-45b7-b53d-2442785382ad tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "DELETE /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48/os-volume_attachments/ee464b49-d7b0-43fe-ab32-b091fadd0591" status: 202 len: 0 microversion: 2.1 time: 0.383001 May 13 17:33:25.380620 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 465/943] 10.222.0.64 () {58 vars in 1415 bytes} [Fri May 13 17:33:24 2022] DELETE /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48/os-volume_attachments/ee464b49-d7b0-43fe-ab32-b091fadd0591 => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:33:25.558844 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-656548b0-1c81-474a-ac70-66382ca11c72 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:25.559396 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-656548b0-1c81-474a-ac70-66382ca11c72 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:25.567042 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-656548b0-1c81-474a-ac70-66382ca11c72 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:25.567521 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-656548b0-1c81-474a-ac70-66382ca11c72 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:25.568299 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-656548b0-1c81-474a-ac70-66382ca11c72 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:25.568734 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-656548b0-1c81-474a-ac70-66382ca11c72 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:25.712749 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-656548b0-1c81-474a-ac70-66382ca11c72 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:25.721217 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-656548b0-1c81-474a-ac70-66382ca11c72 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1756 microversion: 2.1 time: 0.166179 May 13 17:33:25.721786 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 479/944] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:25 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:26.738736 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3543cdb2-752b-422c-a047-a2dc76f1d84c tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:26.739381 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3543cdb2-752b-422c-a047-a2dc76f1d84c tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:26.746777 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3543cdb2-752b-422c-a047-a2dc76f1d84c tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:26.747257 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3543cdb2-752b-422c-a047-a2dc76f1d84c tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:26.748035 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3543cdb2-752b-422c-a047-a2dc76f1d84c tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:26.748471 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3543cdb2-752b-422c-a047-a2dc76f1d84c tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:26.891152 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3543cdb2-752b-422c-a047-a2dc76f1d84c tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:26.900027 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3543cdb2-752b-422c-a047-a2dc76f1d84c tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1759 microversion: 2.1 time: 0.165912 May 13 17:33:26.911451 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 466/945] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:26 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1759 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:28.599598 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0401ac52-4132-416e-9a14-4d6a5f12e290 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:33:28.605990 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0401ac52-4132-416e-9a14-4d6a5f12e290 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:28.606438 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0401ac52-4132-416e-9a14-4d6a5f12e290 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:28.632640 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0401ac52-4132-416e-9a14-4d6a5f12e290 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Going to try to stop instance {{(pid=117493) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 13 17:33:28.800785 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0401ac52-4132-416e-9a14-4d6a5f12e290 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "POST /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48/action" status: 202 len: 0 microversion: 2.1 time: 0.205080 May 13 17:33:28.801297 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 480/946] 10.222.0.64 () {60 vars in 1277 bytes} [Fri May 13 17:33:28 2022] POST /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:33:28.814198 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7b1f237f-c07e-4900-9ec9-5c92ce82acc8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:28.814810 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7b1f237f-c07e-4900-9ec9-5c92ce82acc8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:28.821188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7b1f237f-c07e-4900-9ec9-5c92ce82acc8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:28.822156 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7b1f237f-c07e-4900-9ec9-5c92ce82acc8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:28.822929 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7b1f237f-c07e-4900-9ec9-5c92ce82acc8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:28.823408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7b1f237f-c07e-4900-9ec9-5c92ce82acc8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:28.977531 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7b1f237f-c07e-4900-9ec9-5c92ce82acc8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:28.985129 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7b1f237f-c07e-4900-9ec9-5c92ce82acc8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1678 microversion: 2.1 time: 0.174775 May 13 17:33:28.985772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 467/947] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:28 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1678 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:30.004131 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-19878826-2a0d-4746-b61d-b8ff394e928d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:30.004829 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-19878826-2a0d-4746-b61d-b8ff394e928d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:30.010889 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-19878826-2a0d-4746-b61d-b8ff394e928d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:30.011395 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-19878826-2a0d-4746-b61d-b8ff394e928d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:30.012167 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-19878826-2a0d-4746-b61d-b8ff394e928d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:30.012627 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-19878826-2a0d-4746-b61d-b8ff394e928d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:30.149533 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-19878826-2a0d-4746-b61d-b8ff394e928d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:30.157900 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-19878826-2a0d-4746-b61d-b8ff394e928d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1678 microversion: 2.1 time: 0.158551 May 13 17:33:30.158768 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 481/948] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:29 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:31.174987 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a602aaff-3297-4ed2-bd47-574e03752fdb tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:31.175758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a602aaff-3297-4ed2-bd47-574e03752fdb tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:31.182022 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a602aaff-3297-4ed2-bd47-574e03752fdb tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:31.182469 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a602aaff-3297-4ed2-bd47-574e03752fdb tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:31.183274 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a602aaff-3297-4ed2-bd47-574e03752fdb tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:31.183718 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a602aaff-3297-4ed2-bd47-574e03752fdb tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:31.312146 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a602aaff-3297-4ed2-bd47-574e03752fdb tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:31.319497 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a602aaff-3297-4ed2-bd47-574e03752fdb tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1678 microversion: 2.1 time: 0.148532 May 13 17:33:31.320056 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 468/949] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:31 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:32.336610 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2bf7f4d4-6c56-4ccf-8e1f-333b90c64e90 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:32.337130 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2bf7f4d4-6c56-4ccf-8e1f-333b90c64e90 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:32.343426 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2bf7f4d4-6c56-4ccf-8e1f-333b90c64e90 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:32.343883 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2bf7f4d4-6c56-4ccf-8e1f-333b90c64e90 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:32.344651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2bf7f4d4-6c56-4ccf-8e1f-333b90c64e90 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:32.345097 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2bf7f4d4-6c56-4ccf-8e1f-333b90c64e90 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:32.472878 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2bf7f4d4-6c56-4ccf-8e1f-333b90c64e90 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:32.480860 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2bf7f4d4-6c56-4ccf-8e1f-333b90c64e90 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1678 microversion: 2.1 time: 0.148216 May 13 17:33:32.481415 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 482/950] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:32 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:32.774938 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 17:33:32.775593 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Fri May 13 17:33:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 17:33:33.497353 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1a034c1e-59ab-4f1c-89d6-ce2b67805e77 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:33.499669 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-1a034c1e-59ab-4f1c-89d6-ce2b67805e77 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:33.504390 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1a034c1e-59ab-4f1c-89d6-ce2b67805e77 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:33.504841 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1a034c1e-59ab-4f1c-89d6-ce2b67805e77 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:33.505606 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1a034c1e-59ab-4f1c-89d6-ce2b67805e77 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:33.506042 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1a034c1e-59ab-4f1c-89d6-ce2b67805e77 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:33.635464 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-1a034c1e-59ab-4f1c-89d6-ce2b67805e77 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:33.643016 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-1a034c1e-59ab-4f1c-89d6-ce2b67805e77 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1678 microversion: 2.1 time: 0.150081 May 13 17:33:33.643605 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 469/951] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:33 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:34.659635 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-eccba6d6-dfb6-42d3-b016-d0a6c1074e2c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:34.660273 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-eccba6d6-dfb6-42d3-b016-d0a6c1074e2c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:34.666573 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eccba6d6-dfb6-42d3-b016-d0a6c1074e2c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:34.671434 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eccba6d6-dfb6-42d3-b016-d0a6c1074e2c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:34.671434 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eccba6d6-dfb6-42d3-b016-d0a6c1074e2c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:34.671434 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-eccba6d6-dfb6-42d3-b016-d0a6c1074e2c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:34.797047 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-eccba6d6-dfb6-42d3-b016-d0a6c1074e2c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:34.804406 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-eccba6d6-dfb6-42d3-b016-d0a6c1074e2c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1678 microversion: 2.1 time: 0.148595 May 13 17:33:34.804992 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 483/952] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:34 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:35.821437 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a97af06f-a895-4111-a715-313e7c585e36 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:35.822051 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a97af06f-a895-4111-a715-313e7c585e36 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:35.828367 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a97af06f-a895-4111-a715-313e7c585e36 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:35.828821 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a97af06f-a895-4111-a715-313e7c585e36 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:35.829595 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a97af06f-a895-4111-a715-313e7c585e36 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:35.830043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a97af06f-a895-4111-a715-313e7c585e36 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:35.956095 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a97af06f-a895-4111-a715-313e7c585e36 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:35.963398 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a97af06f-a895-4111-a715-313e7c585e36 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1678 microversion: 2.1 time: 0.145810 May 13 17:33:35.963969 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 470/953] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:35 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:36.981100 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-86ccab0c-c874-4351-96be-545a3c4bf16c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:36.981695 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-86ccab0c-c874-4351-96be-545a3c4bf16c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:36.987909 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-86ccab0c-c874-4351-96be-545a3c4bf16c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:36.988351 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-86ccab0c-c874-4351-96be-545a3c4bf16c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:36.989107 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-86ccab0c-c874-4351-96be-545a3c4bf16c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:36.989538 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-86ccab0c-c874-4351-96be-545a3c4bf16c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:37.116101 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-86ccab0c-c874-4351-96be-545a3c4bf16c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:37.123369 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-86ccab0c-c874-4351-96be-545a3c4bf16c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1678 microversion: 2.1 time: 0.146074 May 13 17:33:37.124009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 484/954] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:36 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:38.140266 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-aecf1227-48c7-4971-918b-abf697e4e72e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:38.140896 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-aecf1227-48c7-4971-918b-abf697e4e72e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:38.147174 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-aecf1227-48c7-4971-918b-abf697e4e72e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:38.147623 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-aecf1227-48c7-4971-918b-abf697e4e72e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:38.148385 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-aecf1227-48c7-4971-918b-abf697e4e72e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:38.148815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-aecf1227-48c7-4971-918b-abf697e4e72e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:38.271772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-aecf1227-48c7-4971-918b-abf697e4e72e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:38.278958 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-aecf1227-48c7-4971-918b-abf697e4e72e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1678 microversion: 2.1 time: 0.142573 May 13 17:33:38.279537 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 471/955] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:38 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1678 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:39.172056 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d464b9f2-3a7f-4b9b-ae65-4eee6c4f1136 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:39.172544 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d464b9f2-3a7f-4b9b-ae65-4eee6c4f1136 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:39.178381 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d464b9f2-3a7f-4b9b-ae65-4eee6c4f1136 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:39.178832 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d464b9f2-3a7f-4b9b-ae65-4eee6c4f1136 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:39.179627 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d464b9f2-3a7f-4b9b-ae65-4eee6c4f1136 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:39.180064 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d464b9f2-3a7f-4b9b-ae65-4eee6c4f1136 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:39.203436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d464b9f2-3a7f-4b9b-ae65-4eee6c4f1136 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2/ips" status: 200 len: 149 microversion: 2.1 time: 0.246196 May 13 17:33:39.204112 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 485/956] 10.222.0.64 () {58 vars in 1247 bytes} [Fri May 13 17:33:38 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2/ips => generated 149 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:33:39.216390 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f155a6e3-3738-417a-9c78-640aa3925daf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ab332c2-36c5-4d07-8b2e-de0f508138b2"}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:33:39.217471 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-f155a6e3-3738-417a-9c78-640aa3925daf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:39.224625 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f155a6e3-3738-417a-9c78-640aa3925daf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:39.225081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f155a6e3-3738-417a-9c78-640aa3925daf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:39.225853 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f155a6e3-3738-417a-9c78-640aa3925daf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:39.226296 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f155a6e3-3738-417a-9c78-640aa3925daf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:39.296537 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-41f66271-0cb0-4b92-8841-17f6b86c89f0 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:39.297158 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-41f66271-0cb0-4b92-8841-17f6b86c89f0 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:39.302430 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-f155a6e3-3738-417a-9c78-640aa3925daf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] HTTP exception thrown: Invalid volume: volume 2ab332c2-36c5-4d07-8b2e-de0f508138b2 is already attached to instances: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 May 13 17:33:39.302959 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-41f66271-0cb0-4b92-8841-17f6b86c89f0 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:39.303441 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-41f66271-0cb0-4b92-8841-17f6b86c89f0 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:39.304214 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-41f66271-0cb0-4b92-8841-17f6b86c89f0 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:39.304317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f155a6e3-3738-417a-9c78-640aa3925daf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Request method failure captured: May 13 17:33:39.304317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: POST /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2/os-volume_attachments HTTP/1.1 May 13 17:33:39.304317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:33:39.304317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:33:39.304317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:33:39.304317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 74 May 13 17:33:39.304317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:33:39.304317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:33:39.304317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:33:39.304317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:33:39.304317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpTc_RrVmxy2iGzrfQJ2JGoLflGoXwQ8zHwIs9aTMpqZXeC78NlpwKZWhCbBdWoUAU_vvb08rrsxX0JsiGqFmgTgDrNVuDQuL1AnwToYH23sqxxCURxc3AiIzkc2Y-1ZSXLpS2OklBXtojTSGTsLp1Uq6KzyDltfns2DlgjWoGsxMc0 May 13 17:33:39.304317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:33:39.304317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:33:39.304317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:33:39.304317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:33:39.304317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:33:39.304317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:33:39.304317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: ae7b37b41d944427945d783a460ca12a May 13 17:33:39.304317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:33:39.304317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:33:39.304317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:33:39.305905 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ae7b37b41d944427945d783a460ca12a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}] May 13 17:33:39.305905 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-AttachVolumeNegativeTest-908235212 May 13 17:33:39.305905 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: ae7b37b41d944427945d783a460ca12a May 13 17:33:39.305905 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:33:39.305905 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:33:39.305905 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:33:39.305905 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:33:39.305905 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: dfc52b61bcf845d1953a5a111abb3666 May 13 17:33:39.305905 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:33:39.305905 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: May 13 17:33:39.305905 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {"volumeAttachment": {"volumeId": "2ab332c2-36c5-4d07-8b2e-de0f508138b2"}} May 13 17:33:39.305905 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: > May 13 17:33:39.306857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Invalid volume: volume 2ab332c2-36c5-4d07-8b2e-de0f508138b2 is already attached to instances: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 May 13 17:33:39.306857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'server_id': '149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2', 'body': {'volumeAttachment': {'volumeId': '2ab332c2-36c5-4d07-8b2e-de0f508138b2'}}} May 13 17:33:39.306857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:33:39.306857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:33:39.306857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 13 17:33:39.306857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 13 17:33:39.306857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 17:33:39.306857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 17:33:39.306857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 13 17:33:39.306857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 13 17:33:39.306857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 13 17:33:39.306857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 13 17:33:39.306857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 13 17:33:39.306857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 13 17:33:39.306857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2ab332c2-36c5-4d07-8b2e-de0f508138b2 is already attached to instances: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 May 13 17:33:39.306857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:33:39.306857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:33:39.306857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:33:39.306857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:33:39.308111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:33:39.308111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:33:39.308111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:33:39.308111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:33:39.308111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:33:39.308111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:33:39.308111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 17:33:39.308111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 17:33:39.308111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 17:33:39.308111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 17:33:39.308111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 17:33:39.308111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 17:33:39.308111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 13 17:33:39.308111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 13 17:33:39.308111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2ab332c2-36c5-4d07-8b2e-de0f508138b2 is already attached to instances: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 May 13 17:33:39.308111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:33:39.308111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:33:39.308111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:33:39.308111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:33:39.308111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:33:39.309335 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:33:39.309335 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:33:39.309335 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:33:39.309335 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2ab332c2-36c5-4d07-8b2e-de0f508138b2 is already attached to instances: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 May 13 17:33:39.309335 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:33:39.309680 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-41f66271-0cb0-4b92-8841-17f6b86c89f0 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:39.309769 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f155a6e3-3738-417a-9c78-640aa3925daf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Returning 400 to user: Invalid volume: volume 2ab332c2-36c5-4d07-8b2e-de0f508138b2 is already attached to instances: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:33:39.309769 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f155a6e3-3738-417a-9c78-640aa3925daf tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "POST /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093359 May 13 17:33:39.309769 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 472/957] 10.222.0.64 () {60 vars in 1322 bytes} [Fri May 13 17:33:39 2022] POST /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 17:33:39.314890 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-877fec01-5c46-4ba6-b49a-7173445395fa tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:39.315422 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-877fec01-5c46-4ba6-b49a-7173445395fa tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:39.321796 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-877fec01-5c46-4ba6-b49a-7173445395fa tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:39.322247 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-877fec01-5c46-4ba6-b49a-7173445395fa tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:39.323015 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-877fec01-5c46-4ba6-b49a-7173445395fa tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:39.323478 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-877fec01-5c46-4ba6-b49a-7173445395fa tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:39.348426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-877fec01-5c46-4ba6-b49a-7173445395fa tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Going to try to terminate instance {{(pid=117492) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 17:33:39.440584 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-41f66271-0cb0-4b92-8841-17f6b86c89f0 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:39.448112 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-41f66271-0cb0-4b92-8841-17f6b86c89f0 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1678 microversion: 2.1 time: 0.155511 May 13 17:33:39.448683 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 486/958] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:39 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:33:39.643008 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-877fec01-5c46-4ba6-b49a-7173445395fa tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "DELETE /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 204 len: 0 microversion: 2.1 time: 0.332050 May 13 17:33:39.643628 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 473/959] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:33:39 2022] DELETE /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 17:33:39.651614 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c84995c7-06ff-4ac1-8cf8-9f7300447468 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:39.652232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c84995c7-06ff-4ac1-8cf8-9f7300447468 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:39.659659 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c84995c7-06ff-4ac1-8cf8-9f7300447468 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:39.663359 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c84995c7-06ff-4ac1-8cf8-9f7300447468 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:39.663359 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c84995c7-06ff-4ac1-8cf8-9f7300447468 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:39.663359 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c84995c7-06ff-4ac1-8cf8-9f7300447468 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:39.790530 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c84995c7-06ff-4ac1-8cf8-9f7300447468 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:39.798502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c84995c7-06ff-4ac1-8cf8-9f7300447468 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1681 microversion: 2.1 time: 0.150636 May 13 17:33:39.799069 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 487/960] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:39 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:40.466350 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-ee0ce58f-ee84-40f1-b2c7-d6ab9883c530 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:40.467072 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-ee0ce58f-ee84-40f1-b2c7-d6ab9883c530 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:40.473975 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ee0ce58f-ee84-40f1-b2c7-d6ab9883c530 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:40.474683 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ee0ce58f-ee84-40f1-b2c7-d6ab9883c530 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:40.475471 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ee0ce58f-ee84-40f1-b2c7-d6ab9883c530 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:40.475905 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ee0ce58f-ee84-40f1-b2c7-d6ab9883c530 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:40.605441 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-ee0ce58f-ee84-40f1-b2c7-d6ab9883c530 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:40.612905 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-ee0ce58f-ee84-40f1-b2c7-d6ab9883c530 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1678 microversion: 2.1 time: 0.150785 May 13 17:33:40.613468 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 474/961] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:40 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:40.815786 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ebe44dd6-4966-4736-82d1-d6a8cb8a0c30 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:40.816303 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ebe44dd6-4966-4736-82d1-d6a8cb8a0c30 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:40.822535 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ebe44dd6-4966-4736-82d1-d6a8cb8a0c30 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:40.822993 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ebe44dd6-4966-4736-82d1-d6a8cb8a0c30 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:40.823788 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ebe44dd6-4966-4736-82d1-d6a8cb8a0c30 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:40.824224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ebe44dd6-4966-4736-82d1-d6a8cb8a0c30 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:40.949574 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ebe44dd6-4966-4736-82d1-d6a8cb8a0c30 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:40.958311 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ebe44dd6-4966-4736-82d1-d6a8cb8a0c30 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1681 microversion: 2.1 time: 0.146858 May 13 17:33:40.958889 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 488/962] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:40 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:41.630143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-9b87947f-4fbc-4384-9c0d-060c7bd3a4e2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:41.630749 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-9b87947f-4fbc-4384-9c0d-060c7bd3a4e2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:41.636987 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9b87947f-4fbc-4384-9c0d-060c7bd3a4e2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:41.637432 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9b87947f-4fbc-4384-9c0d-060c7bd3a4e2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:41.638188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9b87947f-4fbc-4384-9c0d-060c7bd3a4e2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:41.638617 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9b87947f-4fbc-4384-9c0d-060c7bd3a4e2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:41.772899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-9b87947f-4fbc-4384-9c0d-060c7bd3a4e2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:41.780184 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-9b87947f-4fbc-4384-9c0d-060c7bd3a4e2 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1678 microversion: 2.1 time: 0.153869 May 13 17:33:41.780748 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 475/963] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:41 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:41.976029 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4659e156-da92-4654-9d01-0375685f61aa tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:41.976653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4659e156-da92-4654-9d01-0375685f61aa tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:41.983222 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4659e156-da92-4654-9d01-0375685f61aa tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:41.983730 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4659e156-da92-4654-9d01-0375685f61aa tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:41.984516 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4659e156-da92-4654-9d01-0375685f61aa tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:41.985467 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4659e156-da92-4654-9d01-0375685f61aa tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:42.261516 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4659e156-da92-4654-9d01-0375685f61aa tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:42.269299 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4659e156-da92-4654-9d01-0375685f61aa tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1681 microversion: 2.1 time: 0.297514 May 13 17:33:42.269872 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 489/964] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:41 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1681 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:42.798419 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-ff705c4e-3198-4be9-9aba-df418d43c9ea tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:42.800572 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-ff705c4e-3198-4be9-9aba-df418d43c9ea tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:42.808381 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ff705c4e-3198-4be9-9aba-df418d43c9ea tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:42.809072 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ff705c4e-3198-4be9-9aba-df418d43c9ea tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:42.818646 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-503f060b-c98e-4c00-9ce3-709f850c29ea req-cad8119a-151e-4e85-b721-53a4311ce63a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2", "name": "network-vif-deleted", "tag": "59800603-642e-4f31-b41b-ffa2355488f5"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:33:42.820347 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ff705c4e-3198-4be9-9aba-df418d43c9ea tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:42.821120 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ff705c4e-3198-4be9-9aba-df418d43c9ea tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:42.828312 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-503f060b-c98e-4c00-9ce3-709f850c29ea req-cad8119a-151e-4e85-b721-53a4311ce63a service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:42.834271 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-503f060b-c98e-4c00-9ce3-709f850c29ea req-cad8119a-151e-4e85-b721-53a4311ce63a service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:42.853480 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-503f060b-c98e-4c00-9ce3-709f850c29ea req-cad8119a-151e-4e85-b721-53a4311ce63a service nova] Creating event network-vif-deleted:59800603-642e-4f31-b41b-ffa2355488f5 for instance 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 on hv-cinder-84178 May 13 17:33:42.858546 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-503f060b-c98e-4c00-9ce3-709f850c29ea req-cad8119a-151e-4e85-b721-53a4311ce63a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044201 May 13 17:33:42.859540 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 490/965] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:33:42.975396 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-ff705c4e-3198-4be9-9aba-df418d43c9ea tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:42.983105 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-ff705c4e-3198-4be9-9aba-df418d43c9ea tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1678 microversion: 2.1 time: 0.189136 May 13 17:33:42.983921 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 476/966] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:42 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1678 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:43.288152 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7e9fa72f-0414-4d9d-a5dd-c8cf023042a4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:43.288928 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7e9fa72f-0414-4d9d-a5dd-c8cf023042a4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:43.295810 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7e9fa72f-0414-4d9d-a5dd-c8cf023042a4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:43.296273 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7e9fa72f-0414-4d9d-a5dd-c8cf023042a4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:43.297081 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7e9fa72f-0414-4d9d-a5dd-c8cf023042a4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:43.297703 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7e9fa72f-0414-4d9d-a5dd-c8cf023042a4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:43.330494 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7e9fa72f-0414-4d9d-a5dd-c8cf023042a4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:43.330948 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7e9fa72f-0414-4d9d-a5dd-c8cf023042a4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:43.331428 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-7e9fa72f-0414-4d9d-a5dd-c8cf023042a4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lazy-loading 'fault' on Instance uuid 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:33:43.372016 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7e9fa72f-0414-4d9d-a5dd-c8cf023042a4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:43.380430 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7e9fa72f-0414-4d9d-a5dd-c8cf023042a4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 200 len: 1331 microversion: 2.1 time: 0.097692 May 13 17:33:43.381510 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 491/967] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:43 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:33:44.002688 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-159a6334-6bba-427d-bd01-bbaf356a517e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:44.004185 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-159a6334-6bba-427d-bd01-bbaf356a517e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:44.014289 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-159a6334-6bba-427d-bd01-bbaf356a517e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:44.014955 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-159a6334-6bba-427d-bd01-bbaf356a517e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:44.015805 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-159a6334-6bba-427d-bd01-bbaf356a517e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:44.016276 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-159a6334-6bba-427d-bd01-bbaf356a517e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:44.161928 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-159a6334-6bba-427d-bd01-bbaf356a517e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:44.168742 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-159a6334-6bba-427d-bd01-bbaf356a517e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1678 microversion: 2.1 time: 0.171981 May 13 17:33:44.169317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 477/968] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:43 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:44.397227 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fb05a016-f50d-403b-a162-9ea4745410d4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:44.397817 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fb05a016-f50d-403b-a162-9ea4745410d4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:44.404626 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fb05a016-f50d-403b-a162-9ea4745410d4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:44.405076 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fb05a016-f50d-403b-a162-9ea4745410d4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:44.405840 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fb05a016-f50d-403b-a162-9ea4745410d4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:44.406305 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fb05a016-f50d-403b-a162-9ea4745410d4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:44.420028 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-fb05a016-f50d-403b-a162-9ea4745410d4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] HTTP exception thrown: Instance 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 could not be found. May 13 17:33:44.421653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fb05a016-f50d-403b-a162-9ea4745410d4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Request method failure captured: May 13 17:33:44.421653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 HTTP/1.1 May 13 17:33:44.421653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:33:44.421653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:33:44.421653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:33:44.421653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:33:44.421653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:33:44.421653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:33:44.421653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:33:44.421653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:33:44.421653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpTc_RrVmxy2iGzrfQJ2JGoLflGoXwQ8zHwIs9aTMpqZXeC78NlpwKZWhCbBdWoUAU_vvb08rrsxX0JsiGqFmgTgDrNVuDQuL1AnwToYH23sqxxCURxc3AiIzkc2Y-1ZSXLpS2OklBXtojTSGTsLp1Uq6KzyDltfns2DlgjWoGsxMc0 May 13 17:33:44.421653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:33:44.421653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:33:44.421653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:33:44.421653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:33:44.421653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:33:44.421653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:33:44.421653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: ae7b37b41d944427945d783a460ca12a May 13 17:33:44.421653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:33:44.421653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:33:44.421653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:33:44.423898 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ae7b37b41d944427945d783a460ca12a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}] May 13 17:33:44.423898 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-AttachVolumeNegativeTest-908235212 May 13 17:33:44.423898 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: ae7b37b41d944427945d783a460ca12a May 13 17:33:44.423898 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:33:44.423898 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:33:44.423898 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:33:44.423898 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:33:44.423898 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: dfc52b61bcf845d1953a5a111abb3666 May 13 17:33:44.423898 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:33:44.423898 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: > May 13 17:33:44.423898 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Instance 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 could not be found. May 13 17:33:44.423898 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2'} May 13 17:33:44.424821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:33:44.424821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:33:44.424821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:33:44.424821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:33:44.424821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:33:44.424821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:33:44.424821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:33:44.424821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:33:44.424821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:33:44.424821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:33:44.424821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 could not be found. May 13 17:33:44.424821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:33:44.424821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:33:44.424821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:33:44.424821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:33:44.424821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:33:44.424821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:33:44.424821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:33:44.424821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:33:44.424821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:33:44.426326 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:33:44.426326 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:33:44.426326 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:33:44.426326 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:33:44.426326 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:33:44.426326 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:33:44.426326 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:33:44.426326 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 could not be found. May 13 17:33:44.426326 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:33:44.426326 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:33:44.426326 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:33:44.426326 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:33:44.426326 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:33:44.426326 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:33:44.426326 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:33:44.426326 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:33:44.426326 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 could not be found. May 13 17:33:44.426326 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:33:44.430538 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fb05a016-f50d-403b-a162-9ea4745410d4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Returning 404 to user: Instance 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:33:44.430538 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fb05a016-f50d-403b-a162-9ea4745410d4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 404 len: 111 microversion: 2.1 time: 0.030285 May 13 17:33:44.430538 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 492/969] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:44 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:33:44.433803 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3b3095a4-971d-46c2-9037-db10d60f8ce5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '.version_select at 0x7fa0849040d0>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:44.489947 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3b3095a4-971d-46c2-9037-db10d60f8ce5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-879829482" status: 202 len: 0 microversion: 2.1 time: 0.060589 May 13 17:33:44.490635 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 478/970] 10.222.0.64 () {58 vars in 1217 bytes} [Fri May 13 17:33:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-879829482 => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:33:45.186146 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-44a430cd-a7c8-4120-b246-f5851ce788fa tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:45.186752 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-44a430cd-a7c8-4120-b246-f5851ce788fa tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:45.193527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-44a430cd-a7c8-4120-b246-f5851ce788fa tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:45.193975 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-44a430cd-a7c8-4120-b246-f5851ce788fa tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:45.194755 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-44a430cd-a7c8-4120-b246-f5851ce788fa tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:45.195217 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-44a430cd-a7c8-4120-b246-f5851ce788fa tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:45.300428 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-54899d51-8905-402e-8fa7-a7352ff460d4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:45.301336 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-54899d51-8905-402e-8fa7-a7352ff460d4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:45.310141 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-54899d51-8905-402e-8fa7-a7352ff460d4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:45.310712 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-54899d51-8905-402e-8fa7-a7352ff460d4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:45.312063 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-54899d51-8905-402e-8fa7-a7352ff460d4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:45.312904 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-54899d51-8905-402e-8fa7-a7352ff460d4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:45.339925 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-44a430cd-a7c8-4120-b246-f5851ce788fa tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:45.348566 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-44a430cd-a7c8-4120-b246-f5851ce788fa tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1655 microversion: 2.1 time: 0.166260 May 13 17:33:45.349133 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 493/971] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:45 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1655 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:45.365330 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3b565724-9a6b-4cb4-b211-f57c550b0154 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:33:45.371442 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3b565724-9a6b-4cb4-b211-f57c550b0154 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:45.371891 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3b565724-9a6b-4cb4-b211-f57c550b0154 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:45.392419 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.objects.instance [None req-54899d51-8905-402e-8fa7-a7352ff460d4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lazy-loading 'services' on Instance uuid 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 {{(pid=117492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:33:45.398929 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3b565724-9a6b-4cb4-b211-f57c550b0154 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Going to try to start instance {{(pid=117493) start /opt/stack/nova/nova/compute/api.py:2730}} May 13 17:33:45.599815 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3b565724-9a6b-4cb4-b211-f57c550b0154 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "POST /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48/action" status: 202 len: 0 microversion: 2.1 time: 0.237157 May 13 17:33:45.600443 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 494/972] 10.222.0.64 () {60 vars in 1277 bytes} [Fri May 13 17:33:45 2022] POST /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48/action => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 17:33:45.610649 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-18bfacc3-621b-4f1f-8471-2c2f61fea39e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:45.611946 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-18bfacc3-621b-4f1f-8471-2c2f61fea39e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:45.618978 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-18bfacc3-621b-4f1f-8471-2c2f61fea39e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:45.619476 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-18bfacc3-621b-4f1f-8471-2c2f61fea39e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:45.620263 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-18bfacc3-621b-4f1f-8471-2c2f61fea39e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:45.620748 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-18bfacc3-621b-4f1f-8471-2c2f61fea39e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:45.626267 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-54899d51-8905-402e-8fa7-a7352ff460d4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "DELETE /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0/os-volume_attachments/2ab332c2-36c5-4d07-8b2e-de0f508138b2" status: 202 len: 0 microversion: 2.1 time: 0.330116 May 13 17:33:45.630203 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 479/973] 10.222.0.64 () {58 vars in 1415 bytes} [Fri May 13 17:33:45 2022] DELETE /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0/os-volume_attachments/2ab332c2-36c5-4d07-8b2e-de0f508138b2 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 17:33:45.636515 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d705fd6d-6cfb-4503-85db-527351bb281e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:45.637663 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d705fd6d-6cfb-4503-85db-527351bb281e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:45.649796 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d705fd6d-6cfb-4503-85db-527351bb281e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:45.650253 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d705fd6d-6cfb-4503-85db-527351bb281e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:45.651078 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d705fd6d-6cfb-4503-85db-527351bb281e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:45.651492 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d705fd6d-6cfb-4503-85db-527351bb281e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:45.694676 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d705fd6d-6cfb-4503-85db-527351bb281e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062413 May 13 17:33:45.699077 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 480/974] 10.222.0.64 () {58 vars in 1301 bytes} [Fri May 13 17:33:45 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:33:45.814558 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-18bfacc3-621b-4f1f-8471-2c2f61fea39e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:45.821814 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-18bfacc3-621b-4f1f-8471-2c2f61fea39e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1664 microversion: 2.1 time: 0.216671 May 13 17:33:45.822383 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 495/975] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:45 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1664 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:46.706534 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a0bcc037-c073-4a1f-883e-2dc9e4bd4c45 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:46.708223 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a0bcc037-c073-4a1f-883e-2dc9e4bd4c45 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:46.714464 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a0bcc037-c073-4a1f-883e-2dc9e4bd4c45 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:46.714923 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a0bcc037-c073-4a1f-883e-2dc9e4bd4c45 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:46.715772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a0bcc037-c073-4a1f-883e-2dc9e4bd4c45 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:46.716218 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a0bcc037-c073-4a1f-883e-2dc9e4bd4c45 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:46.745661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a0bcc037-c073-4a1f-883e-2dc9e4bd4c45 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043611 May 13 17:33:46.746457 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 481/976] 10.222.0.64 () {58 vars in 1301 bytes} [Fri May 13 17:33:46 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:33:46.839664 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ef429443-6c1b-4f12-8395-2357fe58e401 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:46.840967 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ef429443-6c1b-4f12-8395-2357fe58e401 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:46.847513 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ef429443-6c1b-4f12-8395-2357fe58e401 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:46.849927 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ef429443-6c1b-4f12-8395-2357fe58e401 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:46.849927 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ef429443-6c1b-4f12-8395-2357fe58e401 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:46.849927 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ef429443-6c1b-4f12-8395-2357fe58e401 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:47.164685 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ef429443-6c1b-4f12-8395-2357fe58e401 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:47.172816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ef429443-6c1b-4f12-8395-2357fe58e401 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1664 microversion: 2.1 time: 0.336409 May 13 17:33:47.173384 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 496/977] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:46 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1664 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:47.757556 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6ad4a269-23ef-4414-8b8e-00a371886a50 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:47.758482 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6ad4a269-23ef-4414-8b8e-00a371886a50 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:47.764872 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6ad4a269-23ef-4414-8b8e-00a371886a50 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:47.765320 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6ad4a269-23ef-4414-8b8e-00a371886a50 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:47.766769 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6ad4a269-23ef-4414-8b8e-00a371886a50 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:47.767237 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6ad4a269-23ef-4414-8b8e-00a371886a50 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:47.794834 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6ad4a269-23ef-4414-8b8e-00a371886a50 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041240 May 13 17:33:47.795424 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 482/978] 10.222.0.64 () {58 vars in 1301 bytes} [Fri May 13 17:33:47 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 13 17:33:47.851548 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8283bd10-499e-48b4-9c6c-166293866bde tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:47.852045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8283bd10-499e-48b4-9c6c-166293866bde tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:47.858235 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8283bd10-499e-48b4-9c6c-166293866bde tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:47.858689 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8283bd10-499e-48b4-9c6c-166293866bde tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:47.859490 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8283bd10-499e-48b4-9c6c-166293866bde tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:47.859931 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8283bd10-499e-48b4-9c6c-166293866bde tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:47.884240 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8283bd10-499e-48b4-9c6c-166293866bde tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Going to try to terminate instance {{(pid=117493) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 17:33:48.129079 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8283bd10-499e-48b4-9c6c-166293866bde tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "DELETE /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 204 len: 0 microversion: 2.1 time: 0.281364 May 13 17:33:48.129674 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 497/979] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:33:47 2022] DELETE /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 17:33:48.137725 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-dd0b91c1-eb40-4d39-a016-df6593aec893 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:48.138330 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-dd0b91c1-eb40-4d39-a016-df6593aec893 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:48.144965 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dd0b91c1-eb40-4d39-a016-df6593aec893 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:48.145411 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dd0b91c1-eb40-4d39-a016-df6593aec893 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:48.146172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dd0b91c1-eb40-4d39-a016-df6593aec893 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:48.146606 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dd0b91c1-eb40-4d39-a016-df6593aec893 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:48.190488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f6a43d4d-5722-420c-8801-54b68707910c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:48.191208 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f6a43d4d-5722-420c-8801-54b68707910c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:48.197132 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f6a43d4d-5722-420c-8801-54b68707910c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:48.197574 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f6a43d4d-5722-420c-8801-54b68707910c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:48.198351 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f6a43d4d-5722-420c-8801-54b68707910c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:48.198787 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f6a43d4d-5722-420c-8801-54b68707910c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:48.283381 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-dd0b91c1-eb40-4d39-a016-df6593aec893 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:48.291011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-dd0b91c1-eb40-4d39-a016-df6593aec893 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1682 microversion: 2.1 time: 0.157145 May 13 17:33:48.291939 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 483/980] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:48 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1682 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:33:48.331865 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f6a43d4d-5722-420c-8801-54b68707910c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:48.339153 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f6a43d4d-5722-420c-8801-54b68707910c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1668 microversion: 2.1 time: 0.152897 May 13 17:33:48.341250 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 498/981] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:48 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1668 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:33:48.528100 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-0c61de41-5f4c-4e59-b195-e978b7dff81f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0813a71-55ba-47b5-8c92-6c61750d0459"}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:33:48.530152 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-0c61de41-5f4c-4e59-b195-e978b7dff81f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:48.541219 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0c61de41-5f4c-4e59-b195-e978b7dff81f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:48.541990 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0c61de41-5f4c-4e59-b195-e978b7dff81f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:48.542789 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0c61de41-5f4c-4e59-b195-e978b7dff81f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:48.543278 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0c61de41-5f4c-4e59-b195-e978b7dff81f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:49.307984 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a34d6db5-9f7b-45dd-b00f-f300507f8d21 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:49.308592 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a34d6db5-9f7b-45dd-b00f-f300507f8d21 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:49.315417 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a34d6db5-9f7b-45dd-b00f-f300507f8d21 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:49.315864 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a34d6db5-9f7b-45dd-b00f-f300507f8d21 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:49.316627 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a34d6db5-9f7b-45dd-b00f-f300507f8d21 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:49.317063 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a34d6db5-9f7b-45dd-b00f-f300507f8d21 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:49.449699 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a34d6db5-9f7b-45dd-b00f-f300507f8d21 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:49.457589 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a34d6db5-9f7b-45dd-b00f-f300507f8d21 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1682 microversion: 2.1 time: 0.153456 May 13 17:33:49.458152 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 499/982] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:49 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:33:49.704240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-0c61de41-5f4c-4e59-b195-e978b7dff81f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "POST /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.285825 May 13 17:33:49.705373 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 484/983] 10.222.0.64 () {60 vars in 1322 bytes} [Fri May 13 17:33:48 2022] POST /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c/os-volume_attachments => generated 194 bytes in 1288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:33:50.475693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-462e8672-bd05-4d78-b1d6-56638244d110 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:50.476294 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-462e8672-bd05-4d78-b1d6-56638244d110 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:50.482562 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-462e8672-bd05-4d78-b1d6-56638244d110 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:50.483009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-462e8672-bd05-4d78-b1d6-56638244d110 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:50.483803 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-462e8672-bd05-4d78-b1d6-56638244d110 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:50.484237 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-462e8672-bd05-4d78-b1d6-56638244d110 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:50.582973 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-462e8672-bd05-4d78-b1d6-56638244d110 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:50.590543 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-462e8672-bd05-4d78-b1d6-56638244d110 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1615 microversion: 2.1 time: 0.119742 May 13 17:33:50.591334 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 500/984] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:50 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1615 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:50.826573 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-8c6613b6-4279-461c-823d-c310ce29f36d req-087d8871-2591-4ec0-b82a-4dee544b5650 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "271501e4-dcad-4de1-92a7-8ad28c0dc5e0", "name": "network-vif-deleted", "tag": "6c67b852-5901-4a54-9821-0cbca68ceaca"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:33:50.843774 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-8c6613b6-4279-461c-823d-c310ce29f36d req-087d8871-2591-4ec0-b82a-4dee544b5650 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:50.844592 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-8c6613b6-4279-461c-823d-c310ce29f36d req-087d8871-2591-4ec0-b82a-4dee544b5650 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:50.857570 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-8c6613b6-4279-461c-823d-c310ce29f36d req-087d8871-2591-4ec0-b82a-4dee544b5650 service nova] Creating event network-vif-deleted:6c67b852-5901-4a54-9821-0cbca68ceaca for instance 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 on hv-cinder-84178 May 13 17:33:50.862597 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-8c6613b6-4279-461c-823d-c310ce29f36d req-087d8871-2591-4ec0-b82a-4dee544b5650 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040196 May 13 17:33:50.863896 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 485/985] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:33:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:33:51.612875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c938447d-cba2-425e-ac71-602a888531b2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:51.614225 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c938447d-cba2-425e-ac71-602a888531b2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:51.620642 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c938447d-cba2-425e-ac71-602a888531b2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:51.621333 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c938447d-cba2-425e-ac71-602a888531b2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:51.625532 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c938447d-cba2-425e-ac71-602a888531b2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:51.625981 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c938447d-cba2-425e-ac71-602a888531b2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:51.660385 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c938447d-cba2-425e-ac71-602a888531b2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:51.660501 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c938447d-cba2-425e-ac71-602a888531b2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:51.660899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-c938447d-cba2-425e-ac71-602a888531b2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lazy-loading 'fault' on Instance uuid 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:33:51.710826 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c938447d-cba2-425e-ac71-602a888531b2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:51.718795 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c938447d-cba2-425e-ac71-602a888531b2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 200 len: 1331 microversion: 2.1 time: 0.109669 May 13 17:33:51.719570 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 501/986] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:51 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:52.738006 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a209adec-1694-438b-90ec-234d41258656 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:52.738710 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a209adec-1694-438b-90ec-234d41258656 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:52.746136 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a209adec-1694-438b-90ec-234d41258656 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:52.746591 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a209adec-1694-438b-90ec-234d41258656 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:52.747396 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a209adec-1694-438b-90ec-234d41258656 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:52.747914 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a209adec-1694-438b-90ec-234d41258656 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:52.766877 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-a209adec-1694-438b-90ec-234d41258656 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] HTTP exception thrown: Instance 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 could not be found. May 13 17:33:52.768553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a209adec-1694-438b-90ec-234d41258656 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Request method failure captured: May 13 17:33:52.768553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 HTTP/1.1 May 13 17:33:52.768553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:33:52.768553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:33:52.768553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:33:52.768553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 0 May 13 17:33:52.768553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:33:52.768553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:33:52.768553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:33:52.768553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:33:52.768553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpTc_RrVmxy2iGzrfQJ2JGoLflGoXwQ8zHwIs9aTMpqZXeC78NlpwKZWhCbBdWoUAU_vvb08rrsxX0JsiGqFmgTgDrNVuDQuL1AnwToYH23sqxxCURxc3AiIzkc2Y-1ZSXLpS2OklBXtojTSGTsLp1Uq6KzyDltfns2DlgjWoGsxMc0 May 13 17:33:52.768553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:33:52.768553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:33:52.768553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:33:52.768553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:33:52.768553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:33:52.768553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:33:52.768553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: ae7b37b41d944427945d783a460ca12a May 13 17:33:52.768553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:33:52.768553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:33:52.768553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:33:52.770091 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ae7b37b41d944427945d783a460ca12a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}] May 13 17:33:52.770091 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-AttachVolumeNegativeTest-908235212 May 13 17:33:52.770091 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: ae7b37b41d944427945d783a460ca12a May 13 17:33:52.770091 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:33:52.770091 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:33:52.770091 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:33:52.770091 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:33:52.770091 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: dfc52b61bcf845d1953a5a111abb3666 May 13 17:33:52.770091 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:33:52.770091 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: > May 13 17:33:52.770091 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Instance 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 could not be found. May 13 17:33:52.770091 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'id': '271501e4-dcad-4de1-92a7-8ad28c0dc5e0'} May 13 17:33:52.770953 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:33:52.770953 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:33:52.770953 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:33:52.770953 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:33:52.770953 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:33:52.770953 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:33:52.770953 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:33:52.770953 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:33:52.770953 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:33:52.770953 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:33:52.770953 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 could not be found. May 13 17:33:52.770953 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:33:52.770953 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:33:52.770953 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:33:52.770953 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:33:52.770953 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:33:52.770953 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:33:52.770953 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:33:52.770953 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:33:52.770953 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:33:52.772408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:33:52.772408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:33:52.772408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:33:52.772408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:33:52.772408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:33:52.772408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:33:52.772408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:33:52.772408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 could not be found. May 13 17:33:52.772408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:33:52.772408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:33:52.772408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:33:52.772408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:33:52.772408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:33:52.772408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:33:52.772408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:33:52.772408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:33:52.772408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 could not be found. May 13 17:33:52.772408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:33:52.773714 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a209adec-1694-438b-90ec-234d41258656 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Returning 404 to user: Instance 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 could not be found. {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:33:52.773714 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a209adec-1694-438b-90ec-234d41258656 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 404 len: 111 microversion: 2.1 time: 0.036821 May 13 17:33:52.773714 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 486/987] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:52 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:33:52.778934 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b4eced4d-984b-4076-9ccc-bca8cc4f4f6f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '.version_select at 0x7fa08424d280>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:52.848161 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b4eced4d-984b-4076-9ccc-bca8cc4f4f6f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-639922051" status: 202 len: 0 microversion: 2.1 time: 0.072982 May 13 17:33:52.848738 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 502/988] 10.222.0.64 () {58 vars in 1217 bytes} [Fri May 13 17:33:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-639922051 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:33:53.714385 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-fd5ab034-6069-40d8-afd9-38397bf7cb02 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Action: 'create', calling method: .version_select at 0x7fa0849bd4c0>, body: {"keypair": {"name": "tempest-keypair-462924621", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATwCe2uPUZ8FPGrOeCDuLBKLvRtF/UbnSD1ck/X5+9Z7KCRkWuW9rIWj+nOC8GOTvWPILh07r59I2ngFpS63Mh5c3iJoEnQNGfewWKdQ4FGqrgeiBP4l2ouMDzvievpUQ=="}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:33:53.728349 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-fd5ab034-6069-40d8-afd9-38397bf7cb02 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Getting quotas for project ae7b37b41d944427945d783a460ca12a. Resources: {'key_pairs'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:33:53.731976 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-fd5ab034-6069-40d8-afd9-38397bf7cb02 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Getting quotas for user dfc52b61bcf845d1953a5a111abb3666 and project ae7b37b41d944427945d783a460ca12a. Resources: {'key_pairs'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:33:53.801722 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-fd5ab034-6069-40d8-afd9-38397bf7cb02 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.091249 May 13 17:33:53.802327 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 487/989] 10.222.0.64 () {60 vars in 1158 bytes} [Fri May 13 17:33:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:33:55.804988 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ea151980-ceb3-4274-a240-a6e563758e2e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1969644789", "imageRef": "7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88108179-f685-4c21-8286-b31593459871"}], "security_groups": [{"name": "tempest-securitygroup--1817306930"}], "key_name": "tempest-keypair-462924621", "user_data": "}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:33:55.907797 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.network.neutron [None req-ea151980-ceb3-4274-a240-a6e563758e2e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] validate_networks() for [('88108179-f685-4c21-8286-b31593459871', None, None, None, None, None)] {{(pid=117493) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 17:33:56.357862 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-ea151980-ceb3-4274-a240-a6e563758e2e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Flavor limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 17:33:56.358288 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-ea151980-ceb3-4274-a240-a6e563758e2e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Image limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 17:33:56.358760 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-ea151980-ceb3-4274-a240-a6e563758e2e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Flavor pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 17:33:56.359196 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-ea151980-ceb3-4274-a240-a6e563758e2e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Image pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 17:33:56.359610 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-ea151980-ceb3-4274-a240-a6e563758e2e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 17:33:56.368115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ea151980-ceb3-4274-a240-a6e563758e2e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:56.368563 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ea151980-ceb3-4274-a240-a6e563758e2e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:56.369399 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ea151980-ceb3-4274-a240-a6e563758e2e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:56.369833 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ea151980-ceb3-4274-a240-a6e563758e2e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:56.385694 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-ea151980-ceb3-4274-a240-a6e563758e2e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Getting quotas for project ae7b37b41d944427945d783a460ca12a. Resources: {'ram', 'instances', 'cores'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:33:56.389694 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-ea151980-ceb3-4274-a240-a6e563758e2e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Getting quotas for user dfc52b61bcf845d1953a5a111abb3666 and project ae7b37b41d944427945d783a460ca12a. Resources: {'ram', 'instances', 'cores'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:33:56.400800 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ea151980-ceb3-4274-a240-a6e563758e2e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Going to run 1 instances... {{(pid=117493) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 17:33:56.403014 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ea151980-ceb3-4274-a240-a6e563758e2e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 17:33:56.533477 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ea151980-ceb3-4274-a240-a6e563758e2e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.733079 May 13 17:33:56.534304 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 503/990] 10.222.0.64 () {60 vars in 1146 bytes} [Fri May 13 17:33:55 2022] POST /compute/v2.1/servers => generated 402 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 17:33:56.544605 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-461adc6b-5a1e-495b-a281-5ff58db65c4f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:56.545219 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-461adc6b-5a1e-495b-a281-5ff58db65c4f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:56.602595 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-461adc6b-5a1e-495b-a281-5ff58db65c4f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:56.609228 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-461adc6b-5a1e-495b-a281-5ff58db65c4f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e" status: 200 len: 1241 microversion: 2.1 time: 0.068888 May 13 17:33:56.609758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 488/991] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:56 2022] GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:33:57.626313 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f3f67c74-5112-45b9-bbbb-290735d67164 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:57.626923 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f3f67c74-5112-45b9-bbbb-290735d67164 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:57.632916 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f3f67c74-5112-45b9-bbbb-290735d67164 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:57.633375 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f3f67c74-5112-45b9-bbbb-290735d67164 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:57.634146 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f3f67c74-5112-45b9-bbbb-290735d67164 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:57.634627 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f3f67c74-5112-45b9-bbbb-290735d67164 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:57.694963 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f3f67c74-5112-45b9-bbbb-290735d67164 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:57.703267 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f3f67c74-5112-45b9-bbbb-290735d67164 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e" status: 200 len: 1245 microversion: 2.1 time: 0.080765 May 13 17:33:57.712426 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 504/992] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:57 2022] GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:57.846800 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-84157b06-619b-4686-a656-93b52af2d801 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:57.847457 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-84157b06-619b-4686-a656-93b52af2d801 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:57.853775 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-84157b06-619b-4686-a656-93b52af2d801 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:57.854232 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-84157b06-619b-4686-a656-93b52af2d801 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:57.855009 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-84157b06-619b-4686-a656-93b52af2d801 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:57.855487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-84157b06-619b-4686-a656-93b52af2d801 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:57.883692 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-84157b06-619b-4686-a656-93b52af2d801 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67/os-volume_attachments/acf0d035-7b3f-4b46-84b3-cb637bbb866d" status: 200 len: 194 microversion: 2.20 time: 0.041541 May 13 17:33:57.884393 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 489/993] 10.222.0.64 () {60 vars in 1453 bytes} [Fri May 13 17:33:57 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67/os-volume_attachments/acf0d035-7b3f-4b46-84b3-cb637bbb866d => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 17:33:57.945429 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-929d1d98-5d04-4bca-850b-c4dbb72c8955 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:57.945923 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-929d1d98-5d04-4bca-850b-c4dbb72c8955 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:57.951842 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-929d1d98-5d04-4bca-850b-c4dbb72c8955 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:57.952297 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-929d1d98-5d04-4bca-850b-c4dbb72c8955 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:57.953062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-929d1d98-5d04-4bca-850b-c4dbb72c8955 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:57.953502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-929d1d98-5d04-4bca-850b-c4dbb72c8955 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:58.035795 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-929d1d98-5d04-4bca-850b-c4dbb72c8955 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lazy-loading 'services' on Instance uuid 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:33:58.245487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-df65e9bb-3d0e-4d7a-80e4-74000728c3ee tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:33:58.246439 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-df65e9bb-3d0e-4d7a-80e4-74000728c3ee tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:58.252957 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-df65e9bb-3d0e-4d7a-80e4-74000728c3ee tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:58.253411 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-df65e9bb-3d0e-4d7a-80e4-74000728c3ee tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:58.254183 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-df65e9bb-3d0e-4d7a-80e4-74000728c3ee tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:58.254623 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-df65e9bb-3d0e-4d7a-80e4-74000728c3ee tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:58.258545 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-929d1d98-5d04-4bca-850b-c4dbb72c8955 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "DELETE /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67/os-volume_attachments/acf0d035-7b3f-4b46-84b3-cb637bbb866d" status: 202 len: 0 microversion: 2.20 time: 0.316924 May 13 17:33:58.259240 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 505/994] 10.222.0.64 () {60 vars in 1456 bytes} [Fri May 13 17:33:57 2022] DELETE /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67/os-volume_attachments/acf0d035-7b3f-4b46-84b3-cb637bbb866d => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 13 17:33:58.274413 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d34a3f34-1d8b-42b7-b222-57967a873964 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:58.275580 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d34a3f34-1d8b-42b7-b222-57967a873964 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:58.277590 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.objects.instance [None req-df65e9bb-3d0e-4d7a-80e4-74000728c3ee tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lazy-loading 'flavor' on Instance uuid afe4a882-7b2b-4cfb-99f2-b722277d132c {{(pid=117492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:33:58.281687 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d34a3f34-1d8b-42b7-b222-57967a873964 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:58.282208 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d34a3f34-1d8b-42b7-b222-57967a873964 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:58.282979 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d34a3f34-1d8b-42b7-b222-57967a873964 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:58.283433 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d34a3f34-1d8b-42b7-b222-57967a873964 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:58.311938 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d34a3f34-1d8b-42b7-b222-57967a873964 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041639 May 13 17:33:58.312502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 506/995] 10.222.0.64 () {60 vars in 1342 bytes} [Fri May 13 17:33:58 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 13 17:33:58.652994 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-df65e9bb-3d0e-4d7a-80e4-74000728c3ee tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "POST /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c/action" status: 200 len: 32 microversion: 2.1 time: 0.411505 May 13 17:33:58.653609 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 490/996] 10.222.0.64 () {60 vars in 1277 bytes} [Fri May 13 17:33:58 2022] POST /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c/action => generated 32 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 13 17:33:58.663093 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-85cb63b1-3a12-412d-b3e3-e8bd5ac71e0b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:58.663867 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-85cb63b1-3a12-412d-b3e3-e8bd5ac71e0b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:58.670108 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-85cb63b1-3a12-412d-b3e3-e8bd5ac71e0b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:58.670554 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-85cb63b1-3a12-412d-b3e3-e8bd5ac71e0b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:58.671342 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-85cb63b1-3a12-412d-b3e3-e8bd5ac71e0b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:58.671776 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-85cb63b1-3a12-412d-b3e3-e8bd5ac71e0b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:58.721448 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-200cef16-3d9b-4365-8eec-2a342f025c3c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:58.722093 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-200cef16-3d9b-4365-8eec-2a342f025c3c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:58.728410 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-200cef16-3d9b-4365-8eec-2a342f025c3c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:58.728871 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-200cef16-3d9b-4365-8eec-2a342f025c3c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:58.729648 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-200cef16-3d9b-4365-8eec-2a342f025c3c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:58.730091 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-200cef16-3d9b-4365-8eec-2a342f025c3c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:58.791366 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-200cef16-3d9b-4365-8eec-2a342f025c3c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:58.799168 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-200cef16-3d9b-4365-8eec-2a342f025c3c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e" status: 200 len: 1301 microversion: 2.1 time: 0.082227 May 13 17:33:58.799983 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 491/997] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:58 2022] GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e => generated 1301 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:33:58.806500 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-85cb63b1-3a12-412d-b3e3-e8bd5ac71e0b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:58.814215 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-85cb63b1-3a12-412d-b3e3-e8bd5ac71e0b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1737 microversion: 2.1 time: 0.154969 May 13 17:33:58.814769 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 507/998] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:58 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:33:59.323338 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1c3b758f-8745-4470-befc-1c725261d9a3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:59.324265 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-1c3b758f-8745-4470-befc-1c725261d9a3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:59.331340 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1c3b758f-8745-4470-befc-1c725261d9a3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:59.331797 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1c3b758f-8745-4470-befc-1c725261d9a3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:59.332591 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1c3b758f-8745-4470-befc-1c725261d9a3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:59.333029 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1c3b758f-8745-4470-befc-1c725261d9a3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:59.363092 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-1c3b758f-8745-4470-befc-1c725261d9a3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043756 May 13 17:33:59.366993 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 492/999] 10.222.0.64 () {60 vars in 1342 bytes} [Fri May 13 17:33:59 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 17:33:59.816330 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-dc465227-2d08-44c3-a92c-bc430ceea543 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:59.817529 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-dc465227-2d08-44c3-a92c-bc430ceea543 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:59.823391 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dc465227-2d08-44c3-a92c-bc430ceea543 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:59.823786 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dc465227-2d08-44c3-a92c-bc430ceea543 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:59.824557 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dc465227-2d08-44c3-a92c-bc430ceea543 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:59.824989 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dc465227-2d08-44c3-a92c-bc430ceea543 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:59.832607 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b1d4c429-324a-471d-a484-8ce17f28bdf9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:33:59.833551 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b1d4c429-324a-471d-a484-8ce17f28bdf9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:33:59.840422 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b1d4c429-324a-471d-a484-8ce17f28bdf9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:59.850926 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b1d4c429-324a-471d-a484-8ce17f28bdf9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:59.850926 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b1d4c429-324a-471d-a484-8ce17f28bdf9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:33:59.850926 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b1d4c429-324a-471d-a484-8ce17f28bdf9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:33:59.974166 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b1d4c429-324a-471d-a484-8ce17f28bdf9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:33:59.983041 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b1d4c429-324a-471d-a484-8ce17f28bdf9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1737 microversion: 2.1 time: 0.155104 May 13 17:33:59.983688 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 493/1000] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:59 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:34:00.191788 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-dc465227-2d08-44c3-a92c-bc430ceea543 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:00.202395 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-dc465227-2d08-44c3-a92c-bc430ceea543 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e" status: 200 len: 1299 microversion: 2.1 time: 0.390527 May 13 17:34:00.211736 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 508/1001] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:33:59 2022] GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e => generated 1299 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:00.374323 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3b4b9bc3-eb3e-49de-bafc-d459b5bf46ea tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:00.375322 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3b4b9bc3-eb3e-49de-bafc-d459b5bf46ea tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:00.381758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3b4b9bc3-eb3e-49de-bafc-d459b5bf46ea tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:00.382206 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3b4b9bc3-eb3e-49de-bafc-d459b5bf46ea tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:00.382973 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3b4b9bc3-eb3e-49de-bafc-d459b5bf46ea tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:00.383435 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3b4b9bc3-eb3e-49de-bafc-d459b5bf46ea tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:00.413336 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3b4b9bc3-eb3e-49de-bafc-d459b5bf46ea tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042976 May 13 17:34:00.413926 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 494/1002] 10.222.0.64 () {60 vars in 1342 bytes} [Fri May 13 17:34:00 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:00.470908 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2f311519-c785-43e9-9809-45298863ae88 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:00.471968 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2f311519-c785-43e9-9809-45298863ae88 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:00.478396 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2f311519-c785-43e9-9809-45298863ae88 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:00.480551 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2f311519-c785-43e9-9809-45298863ae88 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:00.480551 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2f311519-c785-43e9-9809-45298863ae88 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:00.480551 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2f311519-c785-43e9-9809-45298863ae88 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:00.508580 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2f311519-c785-43e9-9809-45298863ae88 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Going to try to terminate instance {{(pid=117493) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 17:34:00.852629 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2f311519-c785-43e9-9809-45298863ae88 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "DELETE /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 204 len: 0 microversion: 2.20 time: 0.385121 May 13 17:34:00.853518 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 509/1003] 10.222.0.64 () {60 vars in 1279 bytes} [Fri May 13 17:34:00 2022] DELETE /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 17:34:00.861420 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7da8c087-9a13-487b-9af4-2a51818af288 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:00.862031 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7da8c087-9a13-487b-9af4-2a51818af288 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:00.867780 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7da8c087-9a13-487b-9af4-2a51818af288 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:00.868243 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7da8c087-9a13-487b-9af4-2a51818af288 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:00.869048 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7da8c087-9a13-487b-9af4-2a51818af288 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:00.869485 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7da8c087-9a13-487b-9af4-2a51818af288 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:01.003117 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7da8c087-9a13-487b-9af4-2a51818af288 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:01.007735 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-21d13916-1c51-482d-8b3a-92fe4bb62167 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:01.008443 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-21d13916-1c51-482d-8b3a-92fe4bb62167 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:01.014933 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-21d13916-1c51-482d-8b3a-92fe4bb62167 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:01.015504 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-21d13916-1c51-482d-8b3a-92fe4bb62167 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:01.031885 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-21d13916-1c51-482d-8b3a-92fe4bb62167 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:01.031885 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-21d13916-1c51-482d-8b3a-92fe4bb62167 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:01.032636 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7da8c087-9a13-487b-9af4-2a51818af288 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:01.032636 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7da8c087-9a13-487b-9af4-2a51818af288 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:01.032636 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7da8c087-9a13-487b-9af4-2a51818af288 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.163037 May 13 17:34:01.032895 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 495/1004] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:34:00 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:34:01.211806 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-21d13916-1c51-482d-8b3a-92fe4bb62167 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:01.218881 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b04e5229-0b88-4be7-b75a-49f15d7bb022 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:01.219523 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b04e5229-0b88-4be7-b75a-49f15d7bb022 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:01.222679 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-21d13916-1c51-482d-8b3a-92fe4bb62167 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1737 microversion: 2.1 time: 0.225206 May 13 17:34:01.223427 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 510/1005] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:00 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1737 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:34:01.235564 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b04e5229-0b88-4be7-b75a-49f15d7bb022 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:01.236013 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b04e5229-0b88-4be7-b75a-49f15d7bb022 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:01.236791 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b04e5229-0b88-4be7-b75a-49f15d7bb022 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:01.237227 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b04e5229-0b88-4be7-b75a-49f15d7bb022 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:01.373932 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b04e5229-0b88-4be7-b75a-49f15d7bb022 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:01.382193 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b04e5229-0b88-4be7-b75a-49f15d7bb022 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e" status: 200 len: 1367 microversion: 2.1 time: 0.167386 May 13 17:34:01.382858 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 496/1006] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:01 2022] GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:34:01.462710 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-968af09d-e0cc-4da3-abd3-177a51121c17 req-13beb60a-92ca-4c10-94fd-0c7daf0b97de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8b767fd-1e8b-4b26-8c43-236c7698129e", "tag": "c9743a5a-7193-4cc0-93e6-05a64a6339e1"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:34:01.471005 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-968af09d-e0cc-4da3-abd3-177a51121c17 req-13beb60a-92ca-4c10-94fd-0c7daf0b97de service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:01.471476 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-968af09d-e0cc-4da3-abd3-177a51121c17 req-13beb60a-92ca-4c10-94fd-0c7daf0b97de service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:01.483815 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-968af09d-e0cc-4da3-abd3-177a51121c17 req-13beb60a-92ca-4c10-94fd-0c7daf0b97de service nova] Creating event network-changed:c9743a5a-7193-4cc0-93e6-05a64a6339e1 for instance a8b767fd-1e8b-4b26-8c43-236c7698129e on hv-cinder-84178 May 13 17:34:01.489099 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-968af09d-e0cc-4da3-abd3-177a51121c17 req-13beb60a-92ca-4c10-94fd-0c7daf0b97de service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030880 May 13 17:34:01.489697 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 511/1007] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:34:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:34:02.040144 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-4b0371c6-20a9-449a-875c-800b346366e0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:02.040793 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-4b0371c6-20a9-449a-875c-800b346366e0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:02.047280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4b0371c6-20a9-449a-875c-800b346366e0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:02.047739 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4b0371c6-20a9-449a-875c-800b346366e0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:02.048517 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4b0371c6-20a9-449a-875c-800b346366e0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:02.048958 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4b0371c6-20a9-449a-875c-800b346366e0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:02.176233 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-4b0371c6-20a9-449a-875c-800b346366e0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:02.183976 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-4b0371c6-20a9-449a-875c-800b346366e0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:02.186500 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-4b0371c6-20a9-449a-875c-800b346366e0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:02.186662 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-4b0371c6-20a9-449a-875c-800b346366e0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.150501 May 13 17:34:02.187203 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 497/1008] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:34:02 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:34:02.241469 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f2ad041a-52fc-40c4-9dcf-6b425b19c3f9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:02.242095 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f2ad041a-52fc-40c4-9dcf-6b425b19c3f9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:02.248199 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f2ad041a-52fc-40c4-9dcf-6b425b19c3f9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:02.248649 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f2ad041a-52fc-40c4-9dcf-6b425b19c3f9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:02.249414 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f2ad041a-52fc-40c4-9dcf-6b425b19c3f9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:02.249974 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f2ad041a-52fc-40c4-9dcf-6b425b19c3f9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:02.386177 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f2ad041a-52fc-40c4-9dcf-6b425b19c3f9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:02.394842 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f2ad041a-52fc-40c4-9dcf-6b425b19c3f9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1737 microversion: 2.1 time: 0.158129 May 13 17:34:02.395452 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 512/1009] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:02 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:02.399483 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-c757a13a-a043-433b-9cec-792045bdf5f7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:02.400096 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-c757a13a-a043-433b-9cec-792045bdf5f7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:02.406626 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c757a13a-a043-433b-9cec-792045bdf5f7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:02.407345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c757a13a-a043-433b-9cec-792045bdf5f7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:02.408118 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c757a13a-a043-433b-9cec-792045bdf5f7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:02.409166 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c757a13a-a043-433b-9cec-792045bdf5f7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:02.545483 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c757a13a-a043-433b-9cec-792045bdf5f7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:02.552994 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-c757a13a-a043-433b-9cec-792045bdf5f7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e" status: 200 len: 1367 microversion: 2.1 time: 0.157270 May 13 17:34:02.553605 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 498/1010] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:02 2022] GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:34:03.205360 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-09d5f45c-7afe-4bee-863d-bc49f462097b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:03.206518 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-09d5f45c-7afe-4bee-863d-bc49f462097b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:03.212414 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-09d5f45c-7afe-4bee-863d-bc49f462097b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:03.212871 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-09d5f45c-7afe-4bee-863d-bc49f462097b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:03.213646 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-09d5f45c-7afe-4bee-863d-bc49f462097b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:03.214090 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-09d5f45c-7afe-4bee-863d-bc49f462097b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:03.412076 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-48656998-6771-4a76-8f5f-1704f4c10466 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:03.412610 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-48656998-6771-4a76-8f5f-1704f4c10466 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:03.419269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-48656998-6771-4a76-8f5f-1704f4c10466 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:03.419712 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-48656998-6771-4a76-8f5f-1704f4c10466 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:03.420839 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-48656998-6771-4a76-8f5f-1704f4c10466 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:03.421026 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-48656998-6771-4a76-8f5f-1704f4c10466 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:03.524447 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-09d5f45c-7afe-4bee-863d-bc49f462097b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:03.533141 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-09d5f45c-7afe-4bee-863d-bc49f462097b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:03.534813 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-09d5f45c-7afe-4bee-863d-bc49f462097b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:03.536143 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-09d5f45c-7afe-4bee-863d-bc49f462097b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1723 microversion: 2.20 time: 0.334695 May 13 17:34:03.536784 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 513/1011] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:34:03 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1723 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:34:03.550262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-48656998-6771-4a76-8f5f-1704f4c10466 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:03.558361 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-48656998-6771-4a76-8f5f-1704f4c10466 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1737 microversion: 2.1 time: 0.150224 May 13 17:34:03.558990 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 499/1012] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:03 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:34:03.569949 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a92ee42e-fd40-477d-af97-152405d3aee2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:03.570663 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a92ee42e-fd40-477d-af97-152405d3aee2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:03.576706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a92ee42e-fd40-477d-af97-152405d3aee2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:03.577231 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a92ee42e-fd40-477d-af97-152405d3aee2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:03.578072 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a92ee42e-fd40-477d-af97-152405d3aee2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:03.578590 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a92ee42e-fd40-477d-af97-152405d3aee2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:03.809244 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a92ee42e-fd40-477d-af97-152405d3aee2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:03.817151 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a92ee42e-fd40-477d-af97-152405d3aee2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e" status: 200 len: 1367 microversion: 2.1 time: 0.250978 May 13 17:34:03.817718 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 514/1013] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:03 2022] GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e => generated 1367 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:04.411466 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-dcb39919-d4a6-4858-b6b1-eb561c307b99 req-cb0f6566-f5dd-434e-9491-cca19ba9c2aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "65fdbf1a-f080-4d79-b3f3-c465e5a81c67", "name": "network-vif-deleted", "tag": "41053781-3367-4859-b7f7-eb83af021a82"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:34:04.421188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-dcb39919-d4a6-4858-b6b1-eb561c307b99 req-cb0f6566-f5dd-434e-9491-cca19ba9c2aa service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:04.421843 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-dcb39919-d4a6-4858-b6b1-eb561c307b99 req-cb0f6566-f5dd-434e-9491-cca19ba9c2aa service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:04.435509 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-dcb39919-d4a6-4858-b6b1-eb561c307b99 req-cb0f6566-f5dd-434e-9491-cca19ba9c2aa service nova] Creating event network-vif-deleted:41053781-3367-4859-b7f7-eb83af021a82 for instance 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 on hv-cinder-84178 May 13 17:34:04.443832 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-dcb39919-d4a6-4858-b6b1-eb561c307b99 req-cb0f6566-f5dd-434e-9491-cca19ba9c2aa service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036056 May 13 17:34:04.446831 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 500/1014] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:34:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:34:04.554846 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d8de7cdf-1270-4f6b-b0ed-879d6cb75e4c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:04.555497 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d8de7cdf-1270-4f6b-b0ed-879d6cb75e4c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:04.562253 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d8de7cdf-1270-4f6b-b0ed-879d6cb75e4c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:04.562804 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d8de7cdf-1270-4f6b-b0ed-879d6cb75e4c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:04.563730 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d8de7cdf-1270-4f6b-b0ed-879d6cb75e4c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:04.564174 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d8de7cdf-1270-4f6b-b0ed-879d6cb75e4c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:04.576592 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-e2057a72-51b5-490f-86b8-e5689e123e8e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:04.577275 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-e2057a72-51b5-490f-86b8-e5689e123e8e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:04.584727 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e2057a72-51b5-490f-86b8-e5689e123e8e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:04.585174 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e2057a72-51b5-490f-86b8-e5689e123e8e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:04.585948 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e2057a72-51b5-490f-86b8-e5689e123e8e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:04.586384 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e2057a72-51b5-490f-86b8-e5689e123e8e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:04.643813 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d8de7cdf-1270-4f6b-b0ed-879d6cb75e4c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:04.654232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d8de7cdf-1270-4f6b-b0ed-879d6cb75e4c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:04.656393 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d8de7cdf-1270-4f6b-b0ed-879d6cb75e4c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:04.657691 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d8de7cdf-1270-4f6b-b0ed-879d6cb75e4c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1656 microversion: 2.20 time: 0.106736 May 13 17:34:04.658515 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 515/1015] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:34:04 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1656 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:34:04.746032 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-e2057a72-51b5-490f-86b8-e5689e123e8e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:04.754515 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-e2057a72-51b5-490f-86b8-e5689e123e8e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1737 microversion: 2.1 time: 0.182027 May 13 17:34:04.755088 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 501/1016] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:04 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:34:04.833474 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-89bfef7f-9b6c-4ef0-a286-3f2cf5a7655f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:04.834089 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-89bfef7f-9b6c-4ef0-a286-3f2cf5a7655f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:04.839913 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-89bfef7f-9b6c-4ef0-a286-3f2cf5a7655f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:04.840369 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-89bfef7f-9b6c-4ef0-a286-3f2cf5a7655f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:04.841149 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-89bfef7f-9b6c-4ef0-a286-3f2cf5a7655f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:04.841588 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-89bfef7f-9b6c-4ef0-a286-3f2cf5a7655f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:04.968829 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-89bfef7f-9b6c-4ef0-a286-3f2cf5a7655f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:04.977533 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-89bfef7f-9b6c-4ef0-a286-3f2cf5a7655f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e" status: 200 len: 1367 microversion: 2.1 time: 0.147801 May 13 17:34:04.978126 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 516/1017] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:04 2022] GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:05.676279 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-bef82bd8-a137-4b7d-96d1-2d67484db63d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:05.676935 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-bef82bd8-a137-4b7d-96d1-2d67484db63d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:05.683315 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bef82bd8-a137-4b7d-96d1-2d67484db63d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:05.683770 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bef82bd8-a137-4b7d-96d1-2d67484db63d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:05.684545 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bef82bd8-a137-4b7d-96d1-2d67484db63d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:05.685015 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bef82bd8-a137-4b7d-96d1-2d67484db63d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:05.747039 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-bef82bd8-a137-4b7d-96d1-2d67484db63d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:05.755307 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-bef82bd8-a137-4b7d-96d1-2d67484db63d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:05.756792 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-bef82bd8-a137-4b7d-96d1-2d67484db63d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:05.757944 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-bef82bd8-a137-4b7d-96d1-2d67484db63d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1656 microversion: 2.20 time: 0.085624 May 13 17:34:05.758505 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 502/1018] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:34:05 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1656 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:34:05.771457 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b1b539c6-ba97-476d-a6a8-e6cdb8f4739f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:05.772102 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b1b539c6-ba97-476d-a6a8-e6cdb8f4739f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:05.778358 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b1b539c6-ba97-476d-a6a8-e6cdb8f4739f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:05.778812 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b1b539c6-ba97-476d-a6a8-e6cdb8f4739f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:05.779613 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b1b539c6-ba97-476d-a6a8-e6cdb8f4739f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:05.780053 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b1b539c6-ba97-476d-a6a8-e6cdb8f4739f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:05.903560 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b1b539c6-ba97-476d-a6a8-e6cdb8f4739f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:05.911363 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b1b539c6-ba97-476d-a6a8-e6cdb8f4739f tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1737 microversion: 2.1 time: 0.144303 May 13 17:34:05.911935 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 517/1019] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:05 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1737 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:05.993600 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a346a12b-056a-420a-ac8e-885712b55ec8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:05.994744 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a346a12b-056a-420a-ac8e-885712b55ec8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:06.000176 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a346a12b-056a-420a-ac8e-885712b55ec8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:06.000623 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a346a12b-056a-420a-ac8e-885712b55ec8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:06.001386 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a346a12b-056a-420a-ac8e-885712b55ec8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:06.001857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a346a12b-056a-420a-ac8e-885712b55ec8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:06.138055 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a346a12b-056a-420a-ac8e-885712b55ec8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:06.145383 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a346a12b-056a-420a-ac8e-885712b55ec8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e" status: 200 len: 1367 microversion: 2.1 time: 0.155596 May 13 17:34:06.145948 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 503/1020] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:05 2022] GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:06.777053 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8d8e20c4-9799-4595-8ca5-4e76b8efbc11 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:06.777692 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8d8e20c4-9799-4595-8ca5-4e76b8efbc11 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:06.783958 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8d8e20c4-9799-4595-8ca5-4e76b8efbc11 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:06.784407 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8d8e20c4-9799-4595-8ca5-4e76b8efbc11 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:06.785174 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8d8e20c4-9799-4595-8ca5-4e76b8efbc11 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:06.785614 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8d8e20c4-9799-4595-8ca5-4e76b8efbc11 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:06.816902 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8d8e20c4-9799-4595-8ca5-4e76b8efbc11 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:06.817350 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8d8e20c4-9799-4595-8ca5-4e76b8efbc11 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:06.817799 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-8d8e20c4-9799-4595-8ca5-4e76b8efbc11 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lazy-loading 'fault' on Instance uuid 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:34:06.860375 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8d8e20c4-9799-4595-8ca5-4e76b8efbc11 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:06.868035 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8d8e20c4-9799-4595-8ca5-4e76b8efbc11 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:06.869540 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8d8e20c4-9799-4595-8ca5-4e76b8efbc11 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:06.870696 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8d8e20c4-9799-4595-8ca5-4e76b8efbc11 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 200 len: 1372 microversion: 2.20 time: 0.097562 May 13 17:34:06.871288 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 518/1021] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:34:06 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 1372 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:34:06.928305 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-5855115c-7e39-4645-8bcd-f8bc7c1d58bd tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:06.929012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-5855115c-7e39-4645-8bcd-f8bc7c1d58bd tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:06.935253 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5855115c-7e39-4645-8bcd-f8bc7c1d58bd tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:06.935754 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5855115c-7e39-4645-8bcd-f8bc7c1d58bd tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:06.936520 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5855115c-7e39-4645-8bcd-f8bc7c1d58bd tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:06.936958 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5855115c-7e39-4645-8bcd-f8bc7c1d58bd tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:07.065744 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-5855115c-7e39-4645-8bcd-f8bc7c1d58bd tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:07.073616 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-5855115c-7e39-4645-8bcd-f8bc7c1d58bd tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1737 microversion: 2.1 time: 0.149169 May 13 17:34:07.077073 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 504/1022] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:06 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:07.161093 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-862a2558-204c-4bd2-b140-9af8e962b0d8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:07.161812 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-862a2558-204c-4bd2-b140-9af8e962b0d8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:07.167673 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-862a2558-204c-4bd2-b140-9af8e962b0d8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:07.172044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-862a2558-204c-4bd2-b140-9af8e962b0d8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:07.172044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-862a2558-204c-4bd2-b140-9af8e962b0d8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:07.172044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-862a2558-204c-4bd2-b140-9af8e962b0d8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:07.296686 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-862a2558-204c-4bd2-b140-9af8e962b0d8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:07.303915 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-862a2558-204c-4bd2-b140-9af8e962b0d8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e" status: 200 len: 1367 microversion: 2.1 time: 0.146689 May 13 17:34:07.304471 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 519/1023] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:07 2022] GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:07.888347 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6ef5328d-d282-4283-9d6e-3fba9eafd77e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:07.888899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6ef5328d-d282-4283-9d6e-3fba9eafd77e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:07.895505 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6ef5328d-d282-4283-9d6e-3fba9eafd77e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:07.895917 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6ef5328d-d282-4283-9d6e-3fba9eafd77e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:07.896689 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6ef5328d-d282-4283-9d6e-3fba9eafd77e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:07.897131 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6ef5328d-d282-4283-9d6e-3fba9eafd77e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:07.910024 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-6ef5328d-d282-4283-9d6e-3fba9eafd77e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] HTTP exception thrown: Instance 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 could not be found. May 13 17:34:07.911692 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6ef5328d-d282-4283-9d6e-3fba9eafd77e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Request method failure captured: May 13 17:34:07.911692 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 HTTP/1.1 May 13 17:34:07.911692 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:34:07.911692 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:34:07.911692 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:34:07.911692 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 0 May 13 17:34:07.911692 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:34:07.911692 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:34:07.911692 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:34:07.911692 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:34:07.911692 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpTaRJfB6H8zu6B2CgzgxRB80vA32AaEwFYPYtSaLQa4x9RPPSQqTrlWhMjDoBsvqya2p_q_cyhwT_ilvGKa26b4nWmcU7dgakbW2Rj5sa6EJbnojbsZfsjJCYP50-IeuO6eg4XrZvawrh9WyGeK9SwqFw3DmwpNEjyghK4kCcRW7rU May 13 17:34:07.911692 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:34:07.911692 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:34:07.911692 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:34:07.911692 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:34:07.911692 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Openstack-Nova-Api-Version: 2.20 May 13 17:34:07.911692 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:34:07.911692 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:34:07.911692 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: 6c34f44042ac43cc8a6a7937c0683120 May 13 17:34:07.911692 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-586539843 May 13 17:34:07.911692 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:34:07.911692 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:34:07.913289 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6c34f44042ac43cc8a6a7937c0683120"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6c34f44042ac43cc8a6a7937c0683120"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6c34f44042ac43cc8a6a7937c0683120"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6c34f44042ac43cc8a6a7937c0683120"}]}] May 13 17:34:07.913289 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-AttachVolumeShelveTestJSON-586539843 May 13 17:34:07.913289 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: 6c34f44042ac43cc8a6a7937c0683120 May 13 17:34:07.913289 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-586539843 May 13 17:34:07.913289 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-AttachVolumeShelveTestJSON-586539843-project May 13 17:34:07.913289 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:34:07.913289 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:34:07.913289 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: 57f36ff6dbd24787baf10788bdf8a1f4 May 13 17:34:07.913289 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-AttachVolumeShelveTestJSON-586539843-project May 13 17:34:07.913289 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: > May 13 17:34:07.913289 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Instance 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 could not be found. May 13 17:34:07.913289 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'id': '65fdbf1a-f080-4d79-b3f3-c465e5a81c67'} May 13 17:34:07.914172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:34:07.914172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:34:07.914172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:34:07.914172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:34:07.914172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:34:07.914172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:34:07.914172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:34:07.914172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:34:07.914172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:34:07.914172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:34:07.914172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 could not be found. May 13 17:34:07.914172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:34:07.914172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:34:07.914172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:34:07.914172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:34:07.914172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:34:07.914172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:34:07.914172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:34:07.914172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:34:07.914172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:34:07.920879 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:34:07.920879 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:34:07.920879 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:34:07.920879 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:34:07.920879 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:34:07.920879 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:34:07.920879 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:34:07.920879 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 could not be found. May 13 17:34:07.920879 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:34:07.920879 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:34:07.920879 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:34:07.920879 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:34:07.920879 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:34:07.920879 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:34:07.920879 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:34:07.920879 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:34:07.920879 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 could not be found. May 13 17:34:07.920879 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:34:07.922325 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6ef5328d-d282-4283-9d6e-3fba9eafd77e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Returning 404 to user: Instance 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 could not be found. {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:34:07.922325 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6ef5328d-d282-4283-9d6e-3fba9eafd77e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 404 len: 111 microversion: 2.20 time: 0.028737 May 13 17:34:07.922325 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 505/1024] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:34:07 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 17:34:07.928469 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3ab996b8-be65-4122-b6b6-6cab2ade0a93 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '.version_select at 0x7fa084221160>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:07.986627 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3ab996b8-be65-4122-b6b6-6cab2ade0a93 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1073404996" status: 204 len: 0 microversion: 2.20 time: 0.062680 May 13 17:34:07.987240 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 520/1025] 10.222.0.64 () {60 vars in 1261 bytes} [Fri May 13 17:34:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1073404996 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 17:34:08.094180 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6b296061-2405-46ff-8983-539fc3337bc7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:08.095066 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6b296061-2405-46ff-8983-539fc3337bc7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:08.104264 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6b296061-2405-46ff-8983-539fc3337bc7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:08.105020 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6b296061-2405-46ff-8983-539fc3337bc7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:08.105861 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6b296061-2405-46ff-8983-539fc3337bc7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:08.106314 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6b296061-2405-46ff-8983-539fc3337bc7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:08.243899 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6b296061-2405-46ff-8983-539fc3337bc7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:08.250101 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6b296061-2405-46ff-8983-539fc3337bc7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1737 microversion: 2.1 time: 0.161822 May 13 17:34:08.250672 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 506/1026] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:08 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:08.321709 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7aaf118b-fa9e-4d32-bb90-846bd0f4e2b9 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:08.322285 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7aaf118b-fa9e-4d32-bb90-846bd0f4e2b9 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:08.331144 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7aaf118b-fa9e-4d32-bb90-846bd0f4e2b9 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:08.331144 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7aaf118b-fa9e-4d32-bb90-846bd0f4e2b9 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:08.331144 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7aaf118b-fa9e-4d32-bb90-846bd0f4e2b9 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:08.331144 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7aaf118b-fa9e-4d32-bb90-846bd0f4e2b9 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:08.470351 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7aaf118b-fa9e-4d32-bb90-846bd0f4e2b9 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:08.478493 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7aaf118b-fa9e-4d32-bb90-846bd0f4e2b9 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e" status: 200 len: 1367 microversion: 2.1 time: 0.160861 May 13 17:34:08.479093 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 521/1027] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:08 2022] GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:09.074445 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b07dd508-cd9b-4efb-a332-0e3770056cb9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Action: 'create', calling method: .version_select at 0x7fa084a4b3a0>, body: {"keypair": {"name": "tempest-keypair-1898797271", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGSF5jkcXpdvjQ9J2X+YWorGiJX2rb70KMDae7CrM6IqX5Hh3dg3rEhiAf9bKdrtL2PgzfwNspPOiWq078UnDaTLy9j/KXQiLWfhfkAlu/wNoMqfg6yMfQxWNAYhEvTFDQ=="}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:34:09.088541 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-b07dd508-cd9b-4efb-a332-0e3770056cb9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Getting quotas for project 6c34f44042ac43cc8a6a7937c0683120. Resources: {'key_pairs'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:34:09.092318 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-b07dd508-cd9b-4efb-a332-0e3770056cb9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Getting quotas for user 57f36ff6dbd24787baf10788bdf8a1f4 and project 6c34f44042ac43cc8a6a7937c0683120. Resources: {'key_pairs'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:34:09.168267 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b07dd508-cd9b-4efb-a332-0e3770056cb9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.097664 May 13 17:34:09.169017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 507/1028] 10.222.0.64 () {62 vars in 1199 bytes} [Fri May 13 17:34:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 99 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 13 17:34:09.268955 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-31628bba-69ae-4ada-9710-051eabc3e4ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:09.269594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-31628bba-69ae-4ada-9710-051eabc3e4ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:09.275938 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-31628bba-69ae-4ada-9710-051eabc3e4ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:09.276383 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-31628bba-69ae-4ada-9710-051eabc3e4ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:09.277160 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-31628bba-69ae-4ada-9710-051eabc3e4ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:09.277577 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-31628bba-69ae-4ada-9710-051eabc3e4ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:09.429797 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-31628bba-69ae-4ada-9710-051eabc3e4ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:09.437985 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-31628bba-69ae-4ada-9710-051eabc3e4ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1737 microversion: 2.1 time: 0.173667 May 13 17:34:09.438573 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 522/1029] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:09 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:09.494500 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-af6418b4-acdd-4173-9720-c3e81aea5ef8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:09.495111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-af6418b4-acdd-4173-9720-c3e81aea5ef8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:09.504278 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-af6418b4-acdd-4173-9720-c3e81aea5ef8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:09.504790 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-af6418b4-acdd-4173-9720-c3e81aea5ef8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:09.505714 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-af6418b4-acdd-4173-9720-c3e81aea5ef8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:09.506048 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-af6418b4-acdd-4173-9720-c3e81aea5ef8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:09.579282 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-f8242b5c-adc2-42df-bd5a-329a42902be2 req-367a06e9-1a8b-4755-a137-03f02f43ce59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b767fd-1e8b-4b26-8c43-236c7698129e", "name": "network-vif-plugged", "status": "completed", "tag": "c9743a5a-7193-4cc0-93e6-05a64a6339e1"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:34:09.589044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-f8242b5c-adc2-42df-bd5a-329a42902be2 req-367a06e9-1a8b-4755-a137-03f02f43ce59 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:09.589497 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-f8242b5c-adc2-42df-bd5a-329a42902be2 req-367a06e9-1a8b-4755-a137-03f02f43ce59 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:09.601686 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-f8242b5c-adc2-42df-bd5a-329a42902be2 req-367a06e9-1a8b-4755-a137-03f02f43ce59 service nova] Creating event network-vif-plugged:c9743a5a-7193-4cc0-93e6-05a64a6339e1 for instance a8b767fd-1e8b-4b26-8c43-236c7698129e on hv-cinder-84178 May 13 17:34:09.606729 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-f8242b5c-adc2-42df-bd5a-329a42902be2 req-367a06e9-1a8b-4755-a137-03f02f43ce59 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031684 May 13 17:34:09.610325 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 523/1030] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:34:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:34:09.649107 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-af6418b4-acdd-4173-9720-c3e81aea5ef8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:09.656759 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-af6418b4-acdd-4173-9720-c3e81aea5ef8 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e" status: 200 len: 1367 microversion: 2.1 time: 0.166260 May 13 17:34:09.657597 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 508/1031] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:09 2022] GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:10.457853 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d880d4cf-016d-4908-a901-5feba1eafeea tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:10.458967 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d880d4cf-016d-4908-a901-5feba1eafeea tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:10.465641 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d880d4cf-016d-4908-a901-5feba1eafeea tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:10.466140 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d880d4cf-016d-4908-a901-5feba1eafeea tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:10.467357 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d880d4cf-016d-4908-a901-5feba1eafeea tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:10.467793 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d880d4cf-016d-4908-a901-5feba1eafeea tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:10.636481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d880d4cf-016d-4908-a901-5feba1eafeea tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:10.644937 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d880d4cf-016d-4908-a901-5feba1eafeea tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1737 microversion: 2.1 time: 0.192513 May 13 17:34:10.645519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 524/1032] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:10 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1737 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:10.673727 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-57e44f16-ec49-4704-9010-38a300614cd3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:10.674332 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-57e44f16-ec49-4704-9010-38a300614cd3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:10.680624 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-57e44f16-ec49-4704-9010-38a300614cd3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:10.681075 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-57e44f16-ec49-4704-9010-38a300614cd3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:10.681861 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-57e44f16-ec49-4704-9010-38a300614cd3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:10.682305 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-57e44f16-ec49-4704-9010-38a300614cd3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:10.815995 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-57e44f16-ec49-4704-9010-38a300614cd3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:10.823324 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-57e44f16-ec49-4704-9010-38a300614cd3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e" status: 200 len: 1367 microversion: 2.1 time: 0.153405 May 13 17:34:10.823897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 509/1033] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:10 2022] GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:11.650743 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-53bbd399-a7aa-46ee-a8ae-e2c959219a4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1493359263", "imageRef": "7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42afb35d-ebab-4abb-a123-24b9a2b301c2"}], "security_groups": [{"name": "tempest-securitygroup--1923462956"}], "key_name": "tempest-keypair-1898797271", "user_data": "}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:34:11.663095 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-9ebdc77b-5727-4b0a-a0c9-98860fdd75f8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:11.664157 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-9ebdc77b-5727-4b0a-a0c9-98860fdd75f8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:11.670497 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9ebdc77b-5727-4b0a-a0c9-98860fdd75f8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:11.670833 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9ebdc77b-5727-4b0a-a0c9-98860fdd75f8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:11.671657 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9ebdc77b-5727-4b0a-a0c9-98860fdd75f8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:11.672210 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9ebdc77b-5727-4b0a-a0c9-98860fdd75f8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:11.759780 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.network.neutron [None req-53bbd399-a7aa-46ee-a8ae-e2c959219a4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] validate_networks() for [('42afb35d-ebab-4abb-a123-24b9a2b301c2', None, None, None, None, None)] {{(pid=117493) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 17:34:11.811343 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-9ebdc77b-5727-4b0a-a0c9-98860fdd75f8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:11.819806 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-9ebdc77b-5727-4b0a-a0c9-98860fdd75f8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1737 microversion: 2.1 time: 0.161320 May 13 17:34:11.820586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 510/1034] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:11 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:34:11.840524 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7888de45-07ee-45ac-8c6f-ce3a6b447a1f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:11.841506 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7888de45-07ee-45ac-8c6f-ce3a6b447a1f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:11.847506 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7888de45-07ee-45ac-8c6f-ce3a6b447a1f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:11.847954 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7888de45-07ee-45ac-8c6f-ce3a6b447a1f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:11.848723 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7888de45-07ee-45ac-8c6f-ce3a6b447a1f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:11.849160 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7888de45-07ee-45ac-8c6f-ce3a6b447a1f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:11.977011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7888de45-07ee-45ac-8c6f-ce3a6b447a1f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:11.984367 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7888de45-07ee-45ac-8c6f-ce3a6b447a1f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e" status: 200 len: 1558 microversion: 2.1 time: 0.147957 May 13 17:34:11.984932 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 511/1035] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:11 2022] GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:34:12.001693 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-bab37519-52c9-4b29-a9a6-ac6e0afcf355 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:12.002198 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-bab37519-52c9-4b29-a9a6-ac6e0afcf355 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:12.008094 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bab37519-52c9-4b29-a9a6-ac6e0afcf355 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:12.008552 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bab37519-52c9-4b29-a9a6-ac6e0afcf355 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:12.009320 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bab37519-52c9-4b29-a9a6-ac6e0afcf355 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:12.009755 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bab37519-52c9-4b29-a9a6-ac6e0afcf355 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:12.085600 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-bab37519-52c9-4b29-a9a6-ac6e0afcf355 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087687 May 13 17:34:12.086284 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 512/1036] 10.222.0.64 () {58 vars in 1274 bytes} [Fri May 13 17:34:11 2022] GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e/os-interface => generated 285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:34:12.128663 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-53bbd399-a7aa-46ee-a8ae-e2c959219a4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Flavor limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 17:34:12.133395 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-53bbd399-a7aa-46ee-a8ae-e2c959219a4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Image limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 17:34:12.133395 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-53bbd399-a7aa-46ee-a8ae-e2c959219a4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Flavor pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 17:34:12.133395 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-53bbd399-a7aa-46ee-a8ae-e2c959219a4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Image pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 17:34:12.133395 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-53bbd399-a7aa-46ee-a8ae-e2c959219a4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 17:34:12.152912 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-53bbd399-a7aa-46ee-a8ae-e2c959219a4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:12.153359 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-53bbd399-a7aa-46ee-a8ae-e2c959219a4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:12.154176 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-53bbd399-a7aa-46ee-a8ae-e2c959219a4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:12.154613 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-53bbd399-a7aa-46ee-a8ae-e2c959219a4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:12.173247 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-53bbd399-a7aa-46ee-a8ae-e2c959219a4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Getting quotas for project 6c34f44042ac43cc8a6a7937c0683120. Resources: {'ram', 'instances', 'cores'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:34:12.177384 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-53bbd399-a7aa-46ee-a8ae-e2c959219a4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Getting quotas for user 57f36ff6dbd24787baf10788bdf8a1f4 and project 6c34f44042ac43cc8a6a7937c0683120. Resources: {'ram', 'instances', 'cores'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:34:12.188069 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-53bbd399-a7aa-46ee-a8ae-e2c959219a4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Going to run 1 instances... {{(pid=117493) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 17:34:12.190878 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-53bbd399-a7aa-46ee-a8ae-e2c959219a4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 17:34:12.300268 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-53bbd399-a7aa-46ee-a8ae-e2c959219a4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.653476 May 13 17:34:12.305678 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 525/1037] 10.222.0.64 () {62 vars in 1187 bytes} [Fri May 13 17:34:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 655 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 13 17:34:12.311503 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7b11e873-3648-4c1c-9fe8-93244dc155cd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:12.312118 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7b11e873-3648-4c1c-9fe8-93244dc155cd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:12.379319 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7b11e873-3648-4c1c-9fe8-93244dc155cd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:12.386669 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7b11e873-3648-4c1c-9fe8-93244dc155cd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:12.388326 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7b11e873-3648-4c1c-9fe8-93244dc155cd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:12.389295 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7b11e873-3648-4c1c-9fe8-93244dc155cd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1282 microversion: 2.20 time: 0.081881 May 13 17:34:12.390686 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 513/1038] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:34:12 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1282 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:34:12.837574 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9b9ca92a-90a9-423f-b67c-3378cd23974d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:12.838179 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9b9ca92a-90a9-423f-b67c-3378cd23974d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:12.845338 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9b9ca92a-90a9-423f-b67c-3378cd23974d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:12.845793 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9b9ca92a-90a9-423f-b67c-3378cd23974d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:12.847104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9b9ca92a-90a9-423f-b67c-3378cd23974d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:12.847593 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9b9ca92a-90a9-423f-b67c-3378cd23974d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:12.981364 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9b9ca92a-90a9-423f-b67c-3378cd23974d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:12.993651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9b9ca92a-90a9-423f-b67c-3378cd23974d tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1737 microversion: 2.1 time: 0.159883 May 13 17:34:12.994265 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 526/1039] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:12 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:13.199851 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-69bdf42f-5115-4e78-ad98-9ee7e5eeb558 req-4a22123e-efba-4926-9b07-71ff2bec2a50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8b767fd-1e8b-4b26-8c43-236c7698129e", "tag": "c9743a5a-7193-4cc0-93e6-05a64a6339e1"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:34:13.209235 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-69bdf42f-5115-4e78-ad98-9ee7e5eeb558 req-4a22123e-efba-4926-9b07-71ff2bec2a50 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:13.209724 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-69bdf42f-5115-4e78-ad98-9ee7e5eeb558 req-4a22123e-efba-4926-9b07-71ff2bec2a50 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:13.219878 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-69bdf42f-5115-4e78-ad98-9ee7e5eeb558 req-4a22123e-efba-4926-9b07-71ff2bec2a50 service nova] Creating event network-changed:c9743a5a-7193-4cc0-93e6-05a64a6339e1 for instance a8b767fd-1e8b-4b26-8c43-236c7698129e on hv-cinder-84178 May 13 17:34:13.225260 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-69bdf42f-5115-4e78-ad98-9ee7e5eeb558 req-4a22123e-efba-4926-9b07-71ff2bec2a50 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083939 May 13 17:34:13.225860 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 514/1040] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:34:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:34:13.408421 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fe0842f5-7ebc-45d1-b31d-fcdf9ea2cc35 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:13.409303 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fe0842f5-7ebc-45d1-b31d-fcdf9ea2cc35 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:13.415476 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fe0842f5-7ebc-45d1-b31d-fcdf9ea2cc35 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:13.415933 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fe0842f5-7ebc-45d1-b31d-fcdf9ea2cc35 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:13.416714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fe0842f5-7ebc-45d1-b31d-fcdf9ea2cc35 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:13.417254 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fe0842f5-7ebc-45d1-b31d-fcdf9ea2cc35 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:13.493115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fe0842f5-7ebc-45d1-b31d-fcdf9ea2cc35 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:13.503048 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fe0842f5-7ebc-45d1-b31d-fcdf9ea2cc35 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:13.505046 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fe0842f5-7ebc-45d1-b31d-fcdf9ea2cc35 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:13.506543 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fe0842f5-7ebc-45d1-b31d-fcdf9ea2cc35 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1286 microversion: 2.20 time: 0.102463 May 13 17:34:13.507341 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 527/1041] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:34:13 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1286 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:34:14.011946 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a9031dbb-95d5-4bf6-a06c-2893d07f96f4 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:14.012657 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a9031dbb-95d5-4bf6-a06c-2893d07f96f4 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:14.019004 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a9031dbb-95d5-4bf6-a06c-2893d07f96f4 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:14.023661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a9031dbb-95d5-4bf6-a06c-2893d07f96f4 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:14.023661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a9031dbb-95d5-4bf6-a06c-2893d07f96f4 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:14.023661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a9031dbb-95d5-4bf6-a06c-2893d07f96f4 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:14.162271 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a9031dbb-95d5-4bf6-a06c-2893d07f96f4 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:14.170277 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a9031dbb-95d5-4bf6-a06c-2893d07f96f4 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1737 microversion: 2.1 time: 0.162541 May 13 17:34:14.170860 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 515/1042] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:14 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:14.525017 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d2657227-9bb7-4ed2-880f-50ede46498b8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:14.525858 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d2657227-9bb7-4ed2-880f-50ede46498b8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:14.532664 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d2657227-9bb7-4ed2-880f-50ede46498b8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:14.537127 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d2657227-9bb7-4ed2-880f-50ede46498b8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:14.537127 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d2657227-9bb7-4ed2-880f-50ede46498b8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:14.537127 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d2657227-9bb7-4ed2-880f-50ede46498b8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:14.609299 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d2657227-9bb7-4ed2-880f-50ede46498b8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:14.617629 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d2657227-9bb7-4ed2-880f-50ede46498b8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:14.619818 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d2657227-9bb7-4ed2-880f-50ede46498b8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:14.621127 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d2657227-9bb7-4ed2-880f-50ede46498b8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1342 microversion: 2.20 time: 0.099974 May 13 17:34:14.621697 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 528/1043] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:34:14 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1342 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:34:15.186931 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-ff325a0d-3ede-4906-a9b0-98779336bba6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:15.187580 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-ff325a0d-3ede-4906-a9b0-98779336bba6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:15.194034 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ff325a0d-3ede-4906-a9b0-98779336bba6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:15.194488 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ff325a0d-3ede-4906-a9b0-98779336bba6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:15.195302 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ff325a0d-3ede-4906-a9b0-98779336bba6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:15.195743 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ff325a0d-3ede-4906-a9b0-98779336bba6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:15.338934 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-ff325a0d-3ede-4906-a9b0-98779336bba6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:15.345655 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-ff325a0d-3ede-4906-a9b0-98779336bba6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1737 microversion: 2.1 time: 0.162564 May 13 17:34:15.346260 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 516/1044] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:15 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:15.639892 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-25d78820-69bd-41e1-969e-a21dd0a943d5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:15.640522 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-25d78820-69bd-41e1-969e-a21dd0a943d5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:15.647331 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-25d78820-69bd-41e1-969e-a21dd0a943d5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:15.648372 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-25d78820-69bd-41e1-969e-a21dd0a943d5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:15.649153 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-25d78820-69bd-41e1-969e-a21dd0a943d5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:15.649586 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-25d78820-69bd-41e1-969e-a21dd0a943d5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:15.802676 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-25d78820-69bd-41e1-969e-a21dd0a943d5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:15.810557 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-25d78820-69bd-41e1-969e-a21dd0a943d5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:15.812074 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-25d78820-69bd-41e1-969e-a21dd0a943d5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:15.813178 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-25d78820-69bd-41e1-969e-a21dd0a943d5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1408 microversion: 2.20 time: 0.177215 May 13 17:34:15.813741 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 529/1045] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:34:15 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1408 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:34:16.177741 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-0c5cb1e4-6711-4d0d-b580-36f13d3d8cd4 req-719201c8-f050-48fd-b985-76f7d3dafaae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14e3c7f8-88a0-4922-9bbe-0ebf07125a8a", "tag": "acf21395-ff17-45fa-b717-d3bb2054575b"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:34:16.186483 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-0c5cb1e4-6711-4d0d-b580-36f13d3d8cd4 req-719201c8-f050-48fd-b985-76f7d3dafaae service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:16.186941 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-0c5cb1e4-6711-4d0d-b580-36f13d3d8cd4 req-719201c8-f050-48fd-b985-76f7d3dafaae service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:16.200642 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-0c5cb1e4-6711-4d0d-b580-36f13d3d8cd4 req-719201c8-f050-48fd-b985-76f7d3dafaae service nova] Creating event network-changed:acf21395-ff17-45fa-b717-d3bb2054575b for instance 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a on hv-cinder-84178 May 13 17:34:16.207418 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-0c5cb1e4-6711-4d0d-b580-36f13d3d8cd4 req-719201c8-f050-48fd-b985-76f7d3dafaae service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031805 May 13 17:34:16.207418 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 517/1046] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:34:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:34:16.364919 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2e3b515e-e0c4-4991-89d0-6de73dbdefec tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:16.365644 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2e3b515e-e0c4-4991-89d0-6de73dbdefec tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:16.371648 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2e3b515e-e0c4-4991-89d0-6de73dbdefec tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:16.372099 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2e3b515e-e0c4-4991-89d0-6de73dbdefec tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:16.372938 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2e3b515e-e0c4-4991-89d0-6de73dbdefec tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:16.373406 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2e3b515e-e0c4-4991-89d0-6de73dbdefec tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:16.575978 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2e3b515e-e0c4-4991-89d0-6de73dbdefec tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:16.583882 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2e3b515e-e0c4-4991-89d0-6de73dbdefec tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1737 microversion: 2.1 time: 0.223710 May 13 17:34:16.584455 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 530/1047] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:16 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1737 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:16.832927 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-2c419238-31cf-4e67-a1e9-05bfa4fbd075 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:16.833526 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-2c419238-31cf-4e67-a1e9-05bfa4fbd075 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:16.839776 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2c419238-31cf-4e67-a1e9-05bfa4fbd075 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:16.840222 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2c419238-31cf-4e67-a1e9-05bfa4fbd075 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:16.840979 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2c419238-31cf-4e67-a1e9-05bfa4fbd075 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:16.841411 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2c419238-31cf-4e67-a1e9-05bfa4fbd075 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:16.966043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-2c419238-31cf-4e67-a1e9-05bfa4fbd075 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:16.974370 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-2c419238-31cf-4e67-a1e9-05bfa4fbd075 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:16.976132 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-2c419238-31cf-4e67-a1e9-05bfa4fbd075 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:16.977217 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-2c419238-31cf-4e67-a1e9-05bfa4fbd075 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1408 microversion: 2.20 time: 0.149210 May 13 17:34:16.977771 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 518/1048] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:34:16 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:34:17.601764 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c882d811-bd70-48ce-ad20-8a8445b1b72c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:17.602363 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c882d811-bd70-48ce-ad20-8a8445b1b72c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:17.608766 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c882d811-bd70-48ce-ad20-8a8445b1b72c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:17.609211 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c882d811-bd70-48ce-ad20-8a8445b1b72c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:17.609970 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c882d811-bd70-48ce-ad20-8a8445b1b72c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:17.610403 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c882d811-bd70-48ce-ad20-8a8445b1b72c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:17.734224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c882d811-bd70-48ce-ad20-8a8445b1b72c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:17.742609 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c882d811-bd70-48ce-ad20-8a8445b1b72c tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1737 microversion: 2.1 time: 0.145517 May 13 17:34:17.743190 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 531/1049] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:17 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1737 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:17.995710 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-28bbd653-cc3f-454b-804f-283a0ee7acc0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:17.996352 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-28bbd653-cc3f-454b-804f-283a0ee7acc0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:18.002925 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-28bbd653-cc3f-454b-804f-283a0ee7acc0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:18.003423 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-28bbd653-cc3f-454b-804f-283a0ee7acc0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:18.004197 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-28bbd653-cc3f-454b-804f-283a0ee7acc0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:18.005020 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-28bbd653-cc3f-454b-804f-283a0ee7acc0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:18.130574 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-28bbd653-cc3f-454b-804f-283a0ee7acc0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:18.138521 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-28bbd653-cc3f-454b-804f-283a0ee7acc0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:18.140165 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-28bbd653-cc3f-454b-804f-283a0ee7acc0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:18.141301 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-28bbd653-cc3f-454b-804f-283a0ee7acc0 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1408 microversion: 2.20 time: 0.149655 May 13 17:34:18.141851 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 519/1050] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:34:17 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:34:18.759733 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-06e897d9-7035-4fb4-9721-560676cdc4c6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:18.760349 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-06e897d9-7035-4fb4-9721-560676cdc4c6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:18.766658 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-06e897d9-7035-4fb4-9721-560676cdc4c6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:18.767109 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-06e897d9-7035-4fb4-9721-560676cdc4c6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:18.767908 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-06e897d9-7035-4fb4-9721-560676cdc4c6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:18.768349 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-06e897d9-7035-4fb4-9721-560676cdc4c6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:18.900378 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-06e897d9-7035-4fb4-9721-560676cdc4c6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:18.908093 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-06e897d9-7035-4fb4-9721-560676cdc4c6 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1737 microversion: 2.1 time: 0.152185 May 13 17:34:18.908669 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 532/1051] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:18 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:19.159625 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6c19e51e-6607-44ba-9b1a-6cc9b7d01ca2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:19.160233 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6c19e51e-6607-44ba-9b1a-6cc9b7d01ca2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:19.166451 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6c19e51e-6607-44ba-9b1a-6cc9b7d01ca2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:19.166909 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6c19e51e-6607-44ba-9b1a-6cc9b7d01ca2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:19.167689 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6c19e51e-6607-44ba-9b1a-6cc9b7d01ca2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:19.168130 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6c19e51e-6607-44ba-9b1a-6cc9b7d01ca2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:19.297172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6c19e51e-6607-44ba-9b1a-6cc9b7d01ca2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:19.305301 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6c19e51e-6607-44ba-9b1a-6cc9b7d01ca2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:19.306794 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6c19e51e-6607-44ba-9b1a-6cc9b7d01ca2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:19.307931 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6c19e51e-6607-44ba-9b1a-6cc9b7d01ca2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1408 microversion: 2.20 time: 0.152164 May 13 17:34:19.308496 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 520/1052] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:34:19 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1408 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:34:19.926514 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f9631b21-e49e-4755-8fc2-4dca03882e91 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:19.927180 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f9631b21-e49e-4755-8fc2-4dca03882e91 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:19.933590 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f9631b21-e49e-4755-8fc2-4dca03882e91 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:19.934043 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f9631b21-e49e-4755-8fc2-4dca03882e91 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:19.934823 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f9631b21-e49e-4755-8fc2-4dca03882e91 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:19.935315 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f9631b21-e49e-4755-8fc2-4dca03882e91 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:20.061828 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f9631b21-e49e-4755-8fc2-4dca03882e91 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:20.069419 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f9631b21-e49e-4755-8fc2-4dca03882e91 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1737 microversion: 2.1 time: 0.147515 May 13 17:34:20.069987 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 533/1053] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:19 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:20.326279 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-ee3f5635-e59b-411d-b2d2-dfed1602ea48 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:20.326827 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-ee3f5635-e59b-411d-b2d2-dfed1602ea48 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:20.334186 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ee3f5635-e59b-411d-b2d2-dfed1602ea48 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:20.338584 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ee3f5635-e59b-411d-b2d2-dfed1602ea48 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:20.338584 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ee3f5635-e59b-411d-b2d2-dfed1602ea48 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:20.338584 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ee3f5635-e59b-411d-b2d2-dfed1602ea48 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:20.459738 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-ee3f5635-e59b-411d-b2d2-dfed1602ea48 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:20.467475 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-ee3f5635-e59b-411d-b2d2-dfed1602ea48 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:20.468979 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-ee3f5635-e59b-411d-b2d2-dfed1602ea48 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:20.470086 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-ee3f5635-e59b-411d-b2d2-dfed1602ea48 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1408 microversion: 2.20 time: 0.147802 May 13 17:34:20.470652 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 521/1054] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:34:20 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:34:21.086286 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3bfed514-ce30-4389-abd9-957579700474 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:21.086882 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3bfed514-ce30-4389-abd9-957579700474 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:21.093252 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3bfed514-ce30-4389-abd9-957579700474 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:21.093700 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3bfed514-ce30-4389-abd9-957579700474 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:21.094468 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3bfed514-ce30-4389-abd9-957579700474 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:21.094884 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3bfed514-ce30-4389-abd9-957579700474 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:21.223055 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3bfed514-ce30-4389-abd9-957579700474 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:21.230923 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3bfed514-ce30-4389-abd9-957579700474 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1737 microversion: 2.1 time: 0.148513 May 13 17:34:21.231508 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 534/1055] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:21 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:21.488228 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1884534e-4fc7-443e-935a-bcb471cba77d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:21.488843 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-1884534e-4fc7-443e-935a-bcb471cba77d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:21.495339 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1884534e-4fc7-443e-935a-bcb471cba77d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:21.495797 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1884534e-4fc7-443e-935a-bcb471cba77d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:21.496568 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1884534e-4fc7-443e-935a-bcb471cba77d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:21.497017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1884534e-4fc7-443e-935a-bcb471cba77d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:21.626492 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-1884534e-4fc7-443e-935a-bcb471cba77d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:21.634902 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-1884534e-4fc7-443e-935a-bcb471cba77d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:21.636447 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-1884534e-4fc7-443e-935a-bcb471cba77d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:21.637564 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-1884534e-4fc7-443e-935a-bcb471cba77d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1408 microversion: 2.20 time: 0.153297 May 13 17:34:21.638123 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 522/1056] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:34:21 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:34:21.942240 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-34a1eb10-78f4-4afe-93a2-983c0f0359f2 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:34:21.942773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-34a1eb10-78f4-4afe-93a2-983c0f0359f2 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:21.948690 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-34a1eb10-78f4-4afe-93a2-983c0f0359f2 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:21.949143 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-34a1eb10-78f4-4afe-93a2-983c0f0359f2 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:21.949906 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-34a1eb10-78f4-4afe-93a2-983c0f0359f2 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:21.950351 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-34a1eb10-78f4-4afe-93a2-983c0f0359f2 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:21.974658 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-34a1eb10-78f4-4afe-93a2-983c0f0359f2 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lazy-loading 'flavor' on Instance uuid 7a310844-e208-4f17-a8c9-fd4db4acf00d {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:34:22.248429 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-0037020a-f825-4586-a595-362d89dc6914 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:22.249048 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-0037020a-f825-4586-a595-362d89dc6914 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:22.255475 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0037020a-f825-4586-a595-362d89dc6914 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:22.255931 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0037020a-f825-4586-a595-362d89dc6914 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:22.256705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0037020a-f825-4586-a595-362d89dc6914 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:22.257147 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0037020a-f825-4586-a595-362d89dc6914 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:22.386164 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0037020a-f825-4586-a595-362d89dc6914 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:22.394143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-0037020a-f825-4586-a595-362d89dc6914 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1737 microversion: 2.1 time: 0.149946 May 13 17:34:22.394754 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 523/1057] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:22 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:34:22.429156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-34a1eb10-78f4-4afe-93a2-983c0f0359f2 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "POST /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d/action" status: 202 len: 0 microversion: 2.1 time: 0.595263 May 13 17:34:22.429733 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 535/1058] 10.222.0.64 () {60 vars in 1277 bytes} [Fri May 13 17:34:21 2022] POST /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:34:22.437889 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-25895066-5080-4d9b-9a86-e5b15d42e5fe tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:22.438503 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-25895066-5080-4d9b-9a86-e5b15d42e5fe tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:22.445110 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-25895066-5080-4d9b-9a86-e5b15d42e5fe tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:22.449830 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-25895066-5080-4d9b-9a86-e5b15d42e5fe tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:22.449830 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-25895066-5080-4d9b-9a86-e5b15d42e5fe tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:22.449830 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-25895066-5080-4d9b-9a86-e5b15d42e5fe tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:22.573750 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-25895066-5080-4d9b-9a86-e5b15d42e5fe tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:22.581318 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-25895066-5080-4d9b-9a86-e5b15d42e5fe tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1567 microversion: 2.1 time: 0.147086 May 13 17:34:22.581985 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 524/1059] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:22 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:22.655882 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-dec523db-4697-47f5-a42f-5e5da3636dbe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:22.656565 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-dec523db-4697-47f5-a42f-5e5da3636dbe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:22.662991 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dec523db-4697-47f5-a42f-5e5da3636dbe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:22.663474 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dec523db-4697-47f5-a42f-5e5da3636dbe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:22.664231 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dec523db-4697-47f5-a42f-5e5da3636dbe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:22.664660 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dec523db-4697-47f5-a42f-5e5da3636dbe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:22.789190 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-dec523db-4697-47f5-a42f-5e5da3636dbe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:22.796785 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-dec523db-4697-47f5-a42f-5e5da3636dbe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:22.798292 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-dec523db-4697-47f5-a42f-5e5da3636dbe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:22.799405 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-dec523db-4697-47f5-a42f-5e5da3636dbe tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1408 microversion: 2.20 time: 0.147756 May 13 17:34:22.800009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 536/1060] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:34:22 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1408 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:34:23.412202 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-63aadf5a-1b60-447e-a4cf-9a6a99f14b61 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:23.412672 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-63aadf5a-1b60-447e-a4cf-9a6a99f14b61 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:23.418595 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-63aadf5a-1b60-447e-a4cf-9a6a99f14b61 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:23.419047 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-63aadf5a-1b60-447e-a4cf-9a6a99f14b61 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:23.419903 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-63aadf5a-1b60-447e-a4cf-9a6a99f14b61 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:23.420348 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-63aadf5a-1b60-447e-a4cf-9a6a99f14b61 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:23.551970 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-63aadf5a-1b60-447e-a4cf-9a6a99f14b61 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:23.559873 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-63aadf5a-1b60-447e-a4cf-9a6a99f14b61 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1717 microversion: 2.1 time: 0.152244 May 13 17:34:23.560464 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 525/1061] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:23 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1717 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:23.598594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-cffc2c66-250c-4485-80e8-446b2f40ecbe tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:23.599216 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-cffc2c66-250c-4485-80e8-446b2f40ecbe tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:23.615498 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cffc2c66-250c-4485-80e8-446b2f40ecbe tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:23.615498 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cffc2c66-250c-4485-80e8-446b2f40ecbe tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:23.615498 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cffc2c66-250c-4485-80e8-446b2f40ecbe tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:23.615498 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cffc2c66-250c-4485-80e8-446b2f40ecbe tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:23.623464 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f8a20101-53bf-4653-8fa7-aa5cbf91c264 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:23.623968 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-f8a20101-53bf-4653-8fa7-aa5cbf91c264 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:23.630589 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f8a20101-53bf-4653-8fa7-aa5cbf91c264 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:23.631174 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f8a20101-53bf-4653-8fa7-aa5cbf91c264 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:23.632054 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f8a20101-53bf-4653-8fa7-aa5cbf91c264 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:23.632565 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f8a20101-53bf-4653-8fa7-aa5cbf91c264 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:23.713987 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-f8a20101-53bf-4653-8fa7-aa5cbf91c264 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] HTTP exception thrown: Cannot 'detach_volume' instance afe4a882-7b2b-4cfb-99f2-b722277d132c while it is in vm_state rescued May 13 17:34:23.715640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f8a20101-53bf-4653-8fa7-aa5cbf91c264 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Request method failure captured: May 13 17:34:23.715640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: DELETE /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c/os-volume_attachments/b0813a71-55ba-47b5-8c92-6c61750d0459 HTTP/1.1 May 13 17:34:23.715640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:34:23.715640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:34:23.715640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:34:23.715640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 0 May 13 17:34:23.715640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:34:23.715640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:34:23.715640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:34:23.715640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:34:23.715640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpVDPQ2EZlknyXEVYSbq1zYoA7qgi4TwOnKp1PCBXIVh9BXUHZ-NHURPOT1kGG7ilrBqfjIrle9-DF8hvEreUoI2Wl7a2ReyAgBImyd5i31N1LSELowfKgHaob5uflDcPzm1aA4ceGxUsDXZlHEatd8eQnnzECiIdnl5V_fwiM8ou84 May 13 17:34:23.715640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:34:23.715640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:34:23.715640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:34:23.715640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:34:23.715640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:34:23.715640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:34:23.715640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: 27832590c00f47b7b09c343e892f310a May 13 17:34:23.715640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1094369910 May 13 17:34:23.715640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:34:23.715640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:34:23.717136 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/27832590c00f47b7b09c343e892f310a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/27832590c00f47b7b09c343e892f310a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_27832590c00f47b7b09c343e892f310a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/27832590c00f47b7b09c343e892f310a"}]}] May 13 17:34:23.717136 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1094369910 May 13 17:34:23.717136 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: 27832590c00f47b7b09c343e892f310a May 13 17:34:23.717136 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1094369910 May 13 17:34:23.717136 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-ServerRescueNegativeTestJSON-1094369910-project May 13 17:34:23.717136 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:34:23.717136 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:34:23.717136 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: a0294c57ba3f41bc8cf2cac294bb678c May 13 17:34:23.717136 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1094369910-project May 13 17:34:23.717136 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: > May 13 17:34:23.717136 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Cannot 'detach_volume' instance afe4a882-7b2b-4cfb-99f2-b722277d132c while it is in vm_state rescued May 13 17:34:23.724259 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'server_id': 'afe4a882-7b2b-4cfb-99f2-b722277d132c', 'id': 'b0813a71-55ba-47b5-8c92-6c61750d0459'} May 13 17:34:23.724259 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:34:23.724259 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:34:23.724259 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 13 17:34:23.724259 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 13 17:34:23.724259 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 17:34:23.724259 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 17:34:23.724259 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 13 17:34:23.724259 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 13 17:34:23.724259 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance afe4a882-7b2b-4cfb-99f2-b722277d132c in vm_state rescued. Cannot detach_volume while the instance is in this state. May 13 17:34:23.724259 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:34:23.724259 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:34:23.724259 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:34:23.724259 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:34:23.724259 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:34:23.724259 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:34:23.724259 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:34:23.724259 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:34:23.724259 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:34:23.724259 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:34:23.726763 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 13 17:34:23.726763 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 13 17:34:23.726763 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 13 17:34:23.726763 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 13 17:34:23.726763 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance afe4a882-7b2b-4cfb-99f2-b722277d132c while it is in vm_state rescued May 13 17:34:23.726763 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:34:23.726763 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:34:23.726763 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:34:23.726763 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:34:23.726763 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:34:23.726763 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:34:23.726763 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:34:23.726763 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:34:23.726763 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance afe4a882-7b2b-4cfb-99f2-b722277d132c while it is in vm_state rescued May 13 17:34:23.726763 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:34:23.726763 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f8a20101-53bf-4653-8fa7-aa5cbf91c264 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Returning 409 to user: Cannot 'detach_volume' instance afe4a882-7b2b-4cfb-99f2-b722277d132c while it is in vm_state rescued {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:34:23.728264 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f8a20101-53bf-4653-8fa7-aa5cbf91c264 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "DELETE /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c/os-volume_attachments/b0813a71-55ba-47b5-8c92-6c61750d0459" status: 409 len: 152 microversion: 2.1 time: 0.097651 May 13 17:34:23.728264 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 526/1062] 10.222.0.64 () {58 vars in 1415 bytes} [Fri May 13 17:34:23 2022] DELETE /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c/os-volume_attachments/b0813a71-55ba-47b5-8c92-6c61750d0459 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) May 13 17:34:23.728264 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-80337feb-f319-493d-80e3-773083db9781 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:34:23.728264 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-80337feb-f319-493d-80e3-773083db9781 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:23.735221 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-80337feb-f319-493d-80e3-773083db9781 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:23.735764 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-80337feb-f319-493d-80e3-773083db9781 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:23.736522 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-80337feb-f319-493d-80e3-773083db9781 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:23.736968 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-80337feb-f319-493d-80e3-773083db9781 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:23.754989 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-cffc2c66-250c-4485-80e8-446b2f40ecbe tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:23.762603 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-cffc2c66-250c-4485-80e8-446b2f40ecbe tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1567 microversion: 2.1 time: 0.167799 May 13 17:34:23.763397 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 537/1063] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:23 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:23.820319 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1bb73836-7d34-4743-951c-10574d21c1a7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:23.820918 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1bb73836-7d34-4743-951c-10574d21c1a7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:23.826653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1bb73836-7d34-4743-951c-10574d21c1a7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:23.827097 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1bb73836-7d34-4743-951c-10574d21c1a7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:23.827881 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1bb73836-7d34-4743-951c-10574d21c1a7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:23.828315 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1bb73836-7d34-4743-951c-10574d21c1a7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:23.942930 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-80337feb-f319-493d-80e3-773083db9781 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "POST /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c/action" status: 202 len: 0 microversion: 2.1 time: 0.220317 May 13 17:34:23.943754 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 527/1064] 10.222.0.64 () {60 vars in 1277 bytes} [Fri May 13 17:34:23 2022] POST /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c/action => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 17:34:23.951972 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-c9263a13-7fa0-41f6-829e-e13d9886ffd2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:23.952769 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-c9263a13-7fa0-41f6-829e-e13d9886ffd2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:23.959420 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c9263a13-7fa0-41f6-829e-e13d9886ffd2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:23.959959 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c9263a13-7fa0-41f6-829e-e13d9886ffd2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:23.963784 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c9263a13-7fa0-41f6-829e-e13d9886ffd2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:23.963784 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c9263a13-7fa0-41f6-829e-e13d9886ffd2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:23.966363 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1bb73836-7d34-4743-951c-10574d21c1a7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:23.974095 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1bb73836-7d34-4743-951c-10574d21c1a7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:23.976036 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1bb73836-7d34-4743-951c-10574d21c1a7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:23.977146 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1bb73836-7d34-4743-951c-10574d21c1a7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1408 microversion: 2.20 time: 0.161211 May 13 17:34:23.977694 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 538/1065] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:34:23 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:34:24.097245 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c9263a13-7fa0-41f6-829e-e13d9886ffd2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:24.106264 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-c9263a13-7fa0-41f6-829e-e13d9886ffd2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1725 microversion: 2.1 time: 0.158342 May 13 17:34:24.106844 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 528/1066] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:23 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:34:24.780222 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0be75ed0-0405-422c-b190-cee0d0d4361f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:24.780831 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0be75ed0-0405-422c-b190-cee0d0d4361f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:24.787768 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0be75ed0-0405-422c-b190-cee0d0d4361f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:24.788220 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0be75ed0-0405-422c-b190-cee0d0d4361f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:24.788985 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0be75ed0-0405-422c-b190-cee0d0d4361f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:24.789495 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0be75ed0-0405-422c-b190-cee0d0d4361f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:24.924435 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0be75ed0-0405-422c-b190-cee0d0d4361f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:24.932234 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0be75ed0-0405-422c-b190-cee0d0d4361f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1567 microversion: 2.1 time: 0.155556 May 13 17:34:24.933218 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 539/1067] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:24 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:24.995672 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-8921ce4c-4e7d-4693-a17e-3c007c35c018 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:24.996422 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-8921ce4c-4e7d-4693-a17e-3c007c35c018 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:25.002750 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8921ce4c-4e7d-4693-a17e-3c007c35c018 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:25.003231 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8921ce4c-4e7d-4693-a17e-3c007c35c018 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:25.004549 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8921ce4c-4e7d-4693-a17e-3c007c35c018 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:25.004988 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8921ce4c-4e7d-4693-a17e-3c007c35c018 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:25.123919 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1f2a06e9-3f94-404f-8163-e4ddf2c714a7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:25.124529 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1f2a06e9-3f94-404f-8163-e4ddf2c714a7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:25.131258 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1f2a06e9-3f94-404f-8163-e4ddf2c714a7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:25.131716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1f2a06e9-3f94-404f-8163-e4ddf2c714a7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:25.132504 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1f2a06e9-3f94-404f-8163-e4ddf2c714a7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:25.132939 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1f2a06e9-3f94-404f-8163-e4ddf2c714a7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:25.274280 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1f2a06e9-3f94-404f-8163-e4ddf2c714a7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:25.282491 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1f2a06e9-3f94-404f-8163-e4ddf2c714a7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1725 microversion: 2.1 time: 0.162412 May 13 17:34:25.283100 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 540/1068] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:25 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:34:25.360153 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-8921ce4c-4e7d-4693-a17e-3c007c35c018 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:25.367952 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-8921ce4c-4e7d-4693-a17e-3c007c35c018 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:25.369449 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-8921ce4c-4e7d-4693-a17e-3c007c35c018 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:25.370563 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-8921ce4c-4e7d-4693-a17e-3c007c35c018 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1408 microversion: 2.20 time: 0.379061 May 13 17:34:25.371119 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 529/1069] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:34:24 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1408 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:34:25.854060 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-dcc85db6-8aa4-47bd-8edf-1af128c550aa req-8ba098c7-ab91-4e2a-8805-f70eb82a0020 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e3c7f8-88a0-4922-9bbe-0ebf07125a8a", "name": "network-vif-plugged", "status": "completed", "tag": "acf21395-ff17-45fa-b717-d3bb2054575b"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:34:25.862621 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-dcc85db6-8aa4-47bd-8edf-1af128c550aa req-8ba098c7-ab91-4e2a-8805-f70eb82a0020 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:25.863745 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-dcc85db6-8aa4-47bd-8edf-1af128c550aa req-8ba098c7-ab91-4e2a-8805-f70eb82a0020 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:25.876489 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-dcc85db6-8aa4-47bd-8edf-1af128c550aa req-8ba098c7-ab91-4e2a-8805-f70eb82a0020 service nova] Creating event network-vif-plugged:acf21395-ff17-45fa-b717-d3bb2054575b for instance 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a on hv-cinder-84178 May 13 17:34:25.881606 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-dcc85db6-8aa4-47bd-8edf-1af128c550aa req-8ba098c7-ab91-4e2a-8805-f70eb82a0020 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031832 May 13 17:34:25.882184 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 541/1070] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:34:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:34:25.951656 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3a67d3c8-596d-4117-9b02-f236d4547356 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:25.952262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3a67d3c8-596d-4117-9b02-f236d4547356 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:25.959401 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3a67d3c8-596d-4117-9b02-f236d4547356 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:25.959800 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3a67d3c8-596d-4117-9b02-f236d4547356 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:25.963359 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3a67d3c8-596d-4117-9b02-f236d4547356 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:25.963359 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3a67d3c8-596d-4117-9b02-f236d4547356 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:26.089619 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3a67d3c8-596d-4117-9b02-f236d4547356 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:26.096953 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3a67d3c8-596d-4117-9b02-f236d4547356 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1567 microversion: 2.1 time: 0.149177 May 13 17:34:26.098139 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 530/1071] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:25 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:26.299556 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ff2dffcc-c33f-4855-aab8-ffbb2ec2ab52 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:26.300204 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ff2dffcc-c33f-4855-aab8-ffbb2ec2ab52 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:26.306197 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ff2dffcc-c33f-4855-aab8-ffbb2ec2ab52 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:26.306647 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ff2dffcc-c33f-4855-aab8-ffbb2ec2ab52 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:26.307449 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ff2dffcc-c33f-4855-aab8-ffbb2ec2ab52 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:26.307892 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ff2dffcc-c33f-4855-aab8-ffbb2ec2ab52 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:26.388598 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b0901fe2-df1c-4b98-9fc2-d2ae3b030ab3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:26.389209 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b0901fe2-df1c-4b98-9fc2-d2ae3b030ab3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:26.395613 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b0901fe2-df1c-4b98-9fc2-d2ae3b030ab3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:26.396062 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b0901fe2-df1c-4b98-9fc2-d2ae3b030ab3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:26.396835 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b0901fe2-df1c-4b98-9fc2-d2ae3b030ab3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:26.397275 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b0901fe2-df1c-4b98-9fc2-d2ae3b030ab3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:26.435010 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ff2dffcc-c33f-4855-aab8-ffbb2ec2ab52 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:26.443496 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ff2dffcc-c33f-4855-aab8-ffbb2ec2ab52 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1725 microversion: 2.1 time: 0.148231 May 13 17:34:26.444155 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 542/1072] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:26 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:26.526628 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b0901fe2-df1c-4b98-9fc2-d2ae3b030ab3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:26.534330 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b0901fe2-df1c-4b98-9fc2-d2ae3b030ab3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:26.535937 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b0901fe2-df1c-4b98-9fc2-d2ae3b030ab3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:26.537037 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b0901fe2-df1c-4b98-9fc2-d2ae3b030ab3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1408 microversion: 2.20 time: 0.152404 May 13 17:34:26.537604 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 531/1073] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:34:26 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:34:27.115395 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8f5609e5-fdf2-49b6-b81f-818034963363 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:27.116022 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8f5609e5-fdf2-49b6-b81f-818034963363 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:27.122226 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8f5609e5-fdf2-49b6-b81f-818034963363 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:27.122669 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8f5609e5-fdf2-49b6-b81f-818034963363 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:27.123448 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8f5609e5-fdf2-49b6-b81f-818034963363 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:27.123879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8f5609e5-fdf2-49b6-b81f-818034963363 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:27.259769 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8f5609e5-fdf2-49b6-b81f-818034963363 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:27.267233 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8f5609e5-fdf2-49b6-b81f-818034963363 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1567 microversion: 2.1 time: 0.155686 May 13 17:34:27.267798 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 543/1074] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:27 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:27.461366 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-0e8b0f9b-696a-4c79-a10d-523bfe95c37a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:27.461980 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-0e8b0f9b-696a-4c79-a10d-523bfe95c37a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:27.468336 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0e8b0f9b-696a-4c79-a10d-523bfe95c37a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:27.468793 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0e8b0f9b-696a-4c79-a10d-523bfe95c37a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:27.469574 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0e8b0f9b-696a-4c79-a10d-523bfe95c37a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:27.470014 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0e8b0f9b-696a-4c79-a10d-523bfe95c37a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:27.555115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1a98a604-13e3-4fc0-bfde-597b2cf1b255 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:27.555747 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1a98a604-13e3-4fc0-bfde-597b2cf1b255 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:27.561610 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1a98a604-13e3-4fc0-bfde-597b2cf1b255 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:27.562060 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1a98a604-13e3-4fc0-bfde-597b2cf1b255 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:27.562863 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1a98a604-13e3-4fc0-bfde-597b2cf1b255 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:27.563338 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1a98a604-13e3-4fc0-bfde-597b2cf1b255 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:27.595538 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0e8b0f9b-696a-4c79-a10d-523bfe95c37a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:27.604243 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-0e8b0f9b-696a-4c79-a10d-523bfe95c37a tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1725 microversion: 2.1 time: 0.147303 May 13 17:34:27.604830 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 532/1075] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:27 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1725 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:27.690018 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1a98a604-13e3-4fc0-bfde-597b2cf1b255 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:27.698883 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1a98a604-13e3-4fc0-bfde-597b2cf1b255 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:27.700450 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1a98a604-13e3-4fc0-bfde-597b2cf1b255 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:27.701553 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1a98a604-13e3-4fc0-bfde-597b2cf1b255 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1408 microversion: 2.20 time: 0.150777 May 13 17:34:27.702114 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 544/1076] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:34:27 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1408 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:34:28.285354 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6c7d2fe6-7df9-4d89-9734-ec3cd11d28fd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:28.285870 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6c7d2fe6-7df9-4d89-9734-ec3cd11d28fd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:28.291822 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6c7d2fe6-7df9-4d89-9734-ec3cd11d28fd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:28.292276 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6c7d2fe6-7df9-4d89-9734-ec3cd11d28fd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:28.293049 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6c7d2fe6-7df9-4d89-9734-ec3cd11d28fd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:28.293491 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6c7d2fe6-7df9-4d89-9734-ec3cd11d28fd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:28.433288 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6c7d2fe6-7df9-4d89-9734-ec3cd11d28fd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:28.440671 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6c7d2fe6-7df9-4d89-9734-ec3cd11d28fd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1567 microversion: 2.1 time: 0.159380 May 13 17:34:28.441870 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 533/1077] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:28 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:28.621663 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-818be8b1-3220-480a-8b4a-5b3d78553612 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:28.622273 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-818be8b1-3220-480a-8b4a-5b3d78553612 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:28.628628 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-818be8b1-3220-480a-8b4a-5b3d78553612 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:28.629082 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-818be8b1-3220-480a-8b4a-5b3d78553612 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:28.630475 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-818be8b1-3220-480a-8b4a-5b3d78553612 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:28.630919 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-818be8b1-3220-480a-8b4a-5b3d78553612 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:28.719446 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7b071cb4-a53c-458b-af9d-6cfb26e1004e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:28.720049 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7b071cb4-a53c-458b-af9d-6cfb26e1004e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:28.726935 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7b071cb4-a53c-458b-af9d-6cfb26e1004e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:28.727418 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7b071cb4-a53c-458b-af9d-6cfb26e1004e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:28.728190 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7b071cb4-a53c-458b-af9d-6cfb26e1004e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:28.728623 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7b071cb4-a53c-458b-af9d-6cfb26e1004e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:28.759705 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-818be8b1-3220-480a-8b4a-5b3d78553612 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:28.767717 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-818be8b1-3220-480a-8b4a-5b3d78553612 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1731 microversion: 2.1 time: 0.149833 May 13 17:34:28.768292 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 545/1078] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:28 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:28.784043 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-65c0d4af-fe6c-40af-b296-c865b96044bb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:28.784641 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-65c0d4af-fe6c-40af-b296-c865b96044bb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:28.791065 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-65c0d4af-fe6c-40af-b296-c865b96044bb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:28.791618 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-65c0d4af-fe6c-40af-b296-c865b96044bb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:28.792467 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-65c0d4af-fe6c-40af-b296-c865b96044bb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:28.792985 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-65c0d4af-fe6c-40af-b296-c865b96044bb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:28.868949 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7b071cb4-a53c-458b-af9d-6cfb26e1004e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:28.870793 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-65c0d4af-fe6c-40af-b296-c865b96044bb tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090657 May 13 17:34:28.871439 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 546/1079] 10.222.0.64 () {58 vars in 1274 bytes} [Fri May 13 17:34:28 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:34:28.877203 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7b071cb4-a53c-458b-af9d-6cfb26e1004e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:28.878634 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7b071cb4-a53c-458b-af9d-6cfb26e1004e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:28.879774 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7b071cb4-a53c-458b-af9d-6cfb26e1004e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1408 microversion: 2.20 time: 0.164169 May 13 17:34:28.880321 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 534/1080] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:34:28 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:34:29.458886 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-956544d8-bddc-4501-9bf0-db8406f9fc08 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:29.459527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-956544d8-bddc-4501-9bf0-db8406f9fc08 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:29.465322 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-956544d8-bddc-4501-9bf0-db8406f9fc08 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:29.465766 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-956544d8-bddc-4501-9bf0-db8406f9fc08 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:29.466618 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-956544d8-bddc-4501-9bf0-db8406f9fc08 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:29.466958 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-956544d8-bddc-4501-9bf0-db8406f9fc08 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:29.600773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-956544d8-bddc-4501-9bf0-db8406f9fc08 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:29.608146 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-956544d8-bddc-4501-9bf0-db8406f9fc08 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1567 microversion: 2.1 time: 0.153880 May 13 17:34:29.608711 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 547/1081] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:29 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:29.832054 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-8129d260-52a6-4614-b24c-6bff61907fdf req-25961038-75fd-4cd1-a268-8a654b67be42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe4a882-7b2b-4cfb-99f2-b722277d132c", "tag": "d05de053-6bc4-4262-992c-723e87e69ddf"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:34:29.841058 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-8129d260-52a6-4614-b24c-6bff61907fdf req-25961038-75fd-4cd1-a268-8a654b67be42 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:29.841504 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-8129d260-52a6-4614-b24c-6bff61907fdf req-25961038-75fd-4cd1-a268-8a654b67be42 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:29.855912 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-8129d260-52a6-4614-b24c-6bff61907fdf req-25961038-75fd-4cd1-a268-8a654b67be42 service nova] Creating event network-changed:d05de053-6bc4-4262-992c-723e87e69ddf for instance afe4a882-7b2b-4cfb-99f2-b722277d132c on hv-cinder-84178 May 13 17:34:29.860750 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-8129d260-52a6-4614-b24c-6bff61907fdf req-25961038-75fd-4cd1-a268-8a654b67be42 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032326 May 13 17:34:29.861395 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 535/1082] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:34:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:34:29.897746 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-05cd77c3-8fc2-4bb1-b768-5d83a3d1c132 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:29.900067 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-05cd77c3-8fc2-4bb1-b768-5d83a3d1c132 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:29.904646 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-05cd77c3-8fc2-4bb1-b768-5d83a3d1c132 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:29.905130 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-05cd77c3-8fc2-4bb1-b768-5d83a3d1c132 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:29.905842 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-05cd77c3-8fc2-4bb1-b768-5d83a3d1c132 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:29.906278 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-05cd77c3-8fc2-4bb1-b768-5d83a3d1c132 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:30.064587 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-05cd77c3-8fc2-4bb1-b768-5d83a3d1c132 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:30.072891 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-05cd77c3-8fc2-4bb1-b768-5d83a3d1c132 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:30.074423 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-05cd77c3-8fc2-4bb1-b768-5d83a3d1c132 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:30.075572 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-05cd77c3-8fc2-4bb1-b768-5d83a3d1c132 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1408 microversion: 2.20 time: 0.181762 May 13 17:34:30.076130 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 548/1083] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:34:29 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:34:30.625838 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-e5a1281e-eb52-4291-9527-c53dae357b1a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:30.630191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-e5a1281e-eb52-4291-9527-c53dae357b1a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:30.633347 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e5a1281e-eb52-4291-9527-c53dae357b1a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:30.633809 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e5a1281e-eb52-4291-9527-c53dae357b1a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:30.634645 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e5a1281e-eb52-4291-9527-c53dae357b1a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:30.635080 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e5a1281e-eb52-4291-9527-c53dae357b1a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:30.778145 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-e5a1281e-eb52-4291-9527-c53dae357b1a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:30.785691 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-e5a1281e-eb52-4291-9527-c53dae357b1a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1567 microversion: 2.1 time: 0.164580 May 13 17:34:30.790082 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 536/1084] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:30 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:31.093975 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-89625efa-e608-4337-bdce-c07d3d331cc4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:31.094511 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-89625efa-e608-4337-bdce-c07d3d331cc4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:31.101043 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-89625efa-e608-4337-bdce-c07d3d331cc4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:31.101490 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-89625efa-e608-4337-bdce-c07d3d331cc4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:31.102261 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-89625efa-e608-4337-bdce-c07d3d331cc4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:31.102714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-89625efa-e608-4337-bdce-c07d3d331cc4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:31.231663 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-89625efa-e608-4337-bdce-c07d3d331cc4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:31.239882 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-89625efa-e608-4337-bdce-c07d3d331cc4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:31.241365 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-89625efa-e608-4337-bdce-c07d3d331cc4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:31.242539 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-89625efa-e608-4337-bdce-c07d3d331cc4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1600 microversion: 2.20 time: 0.152584 May 13 17:34:31.243098 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 549/1085] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:34:31 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:34:31.260370 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3ba7c08e-ed4a-451c-8142-73820870e1cb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:31.260862 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3ba7c08e-ed4a-451c-8142-73820870e1cb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:31.266616 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3ba7c08e-ed4a-451c-8142-73820870e1cb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:31.267065 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3ba7c08e-ed4a-451c-8142-73820870e1cb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:31.267879 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3ba7c08e-ed4a-451c-8142-73820870e1cb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:31.268320 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3ba7c08e-ed4a-451c-8142-73820870e1cb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:31.342365 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3ba7c08e-ed4a-451c-8142-73820870e1cb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.085939 May 13 17:34:31.342972 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 537/1086] 10.222.0.64 () {60 vars in 1315 bytes} [Fri May 13 17:34:31 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a/os-interface => generated 284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 17:34:31.804051 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a1dfcd67-e8c6-434b-93c1-b0a981238320 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:31.804658 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a1dfcd67-e8c6-434b-93c1-b0a981238320 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:31.810424 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a1dfcd67-e8c6-434b-93c1-b0a981238320 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:31.810874 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a1dfcd67-e8c6-434b-93c1-b0a981238320 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:31.811682 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a1dfcd67-e8c6-434b-93c1-b0a981238320 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:31.812117 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a1dfcd67-e8c6-434b-93c1-b0a981238320 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:31.876142 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-7c34ff91-842e-45c3-bf05-fde088e30c51 req-b2d19122-6fb2-44a4-81e3-6c59bdf3605f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "afe4a882-7b2b-4cfb-99f2-b722277d132c", "tag": "d05de053-6bc4-4262-992c-723e87e69ddf"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:34:31.884056 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-7c34ff91-842e-45c3-bf05-fde088e30c51 req-b2d19122-6fb2-44a4-81e3-6c59bdf3605f service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:31.884499 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-7c34ff91-842e-45c3-bf05-fde088e30c51 req-b2d19122-6fb2-44a4-81e3-6c59bdf3605f service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:31.895774 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-7c34ff91-842e-45c3-bf05-fde088e30c51 req-b2d19122-6fb2-44a4-81e3-6c59bdf3605f service nova] Creating event network-changed:d05de053-6bc4-4262-992c-723e87e69ddf for instance afe4a882-7b2b-4cfb-99f2-b722277d132c on hv-cinder-84178 May 13 17:34:31.900684 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-7c34ff91-842e-45c3-bf05-fde088e30c51 req-b2d19122-6fb2-44a4-81e3-6c59bdf3605f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028681 May 13 17:34:31.905976 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 538/1087] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:34:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:34:31.946169 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a1dfcd67-e8c6-434b-93c1-b0a981238320 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:31.953993 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a1dfcd67-e8c6-434b-93c1-b0a981238320 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1567 microversion: 2.1 time: 0.154400 May 13 17:34:31.954785 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 550/1088] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:31 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:32.972585 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-5fb495ce-e8d5-4847-beb0-a6739e9a7ff0 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:32.973441 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-5fb495ce-e8d5-4847-beb0-a6739e9a7ff0 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:32.979880 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5fb495ce-e8d5-4847-beb0-a6739e9a7ff0 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:32.980331 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5fb495ce-e8d5-4847-beb0-a6739e9a7ff0 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:32.981104 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5fb495ce-e8d5-4847-beb0-a6739e9a7ff0 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:32.981591 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5fb495ce-e8d5-4847-beb0-a6739e9a7ff0 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:33.114968 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-5fb495ce-e8d5-4847-beb0-a6739e9a7ff0 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:33.122395 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-5fb495ce-e8d5-4847-beb0-a6739e9a7ff0 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1567 microversion: 2.1 time: 0.154508 May 13 17:34:33.122954 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 539/1089] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:32 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:33.926420 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-73ef3377-f41a-4f38-a389-23f42f0fbf62 req-9fd1a1df-0ba5-480c-a65c-98a12f85a23e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14e3c7f8-88a0-4922-9bbe-0ebf07125a8a", "tag": "acf21395-ff17-45fa-b717-d3bb2054575b"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:34:33.934776 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-73ef3377-f41a-4f38-a389-23f42f0fbf62 req-9fd1a1df-0ba5-480c-a65c-98a12f85a23e service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:33.935253 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-73ef3377-f41a-4f38-a389-23f42f0fbf62 req-9fd1a1df-0ba5-480c-a65c-98a12f85a23e service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:33.946493 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-73ef3377-f41a-4f38-a389-23f42f0fbf62 req-9fd1a1df-0ba5-480c-a65c-98a12f85a23e service nova] Creating event network-changed:acf21395-ff17-45fa-b717-d3bb2054575b for instance 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a on hv-cinder-84178 May 13 17:34:33.951471 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-73ef3377-f41a-4f38-a389-23f42f0fbf62 req-9fd1a1df-0ba5-480c-a65c-98a12f85a23e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028685 May 13 17:34:33.952062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 551/1090] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:34:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:34:34.139646 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-9217cd01-8987-47f1-acd7-6d81debd9ef7 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:34.140266 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-9217cd01-8987-47f1-acd7-6d81debd9ef7 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:34.147068 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9217cd01-8987-47f1-acd7-6d81debd9ef7 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:34.147559 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9217cd01-8987-47f1-acd7-6d81debd9ef7 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:34.148348 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9217cd01-8987-47f1-acd7-6d81debd9ef7 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:34.148806 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9217cd01-8987-47f1-acd7-6d81debd9ef7 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:34.276929 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-9217cd01-8987-47f1-acd7-6d81debd9ef7 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:34.284676 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-9217cd01-8987-47f1-acd7-6d81debd9ef7 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1567 microversion: 2.1 time: 0.148908 May 13 17:34:34.285271 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 540/1091] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:34 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:34.413239 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5cc19581-8134-4684-a1be-6fbcf38f78e6 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-452571533"}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:34:34.414018 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5cc19581-8134-4684-a1be-6fbcf38f78e6 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:34.420111 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5cc19581-8134-4684-a1be-6fbcf38f78e6 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:34.420567 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5cc19581-8134-4684-a1be-6fbcf38f78e6 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:34.421336 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5cc19581-8134-4684-a1be-6fbcf38f78e6 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:34.421773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5cc19581-8134-4684-a1be-6fbcf38f78e6 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:34.577517 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.network.security_group_api [None req-5cc19581-8134-4684-a1be-6fbcf38f78e6 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Removing security group 25628f21-2480-4d12-a2e2-3c0504bba483 from port 53b14020-f762-46c1-859f-588cb62cbd07 May 13 17:34:34.969863 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5cc19581-8134-4684-a1be-6fbcf38f78e6 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "POST /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98/action" status: 202 len: 0 microversion: 2.1 time: 0.658424 May 13 17:34:34.970855 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 552/1092] 10.222.0.64 () {60 vars in 1277 bytes} [Fri May 13 17:34:34 2022] POST /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98/action => generated 0 bytes in 660 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:34:34.984228 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-de2385fe-8e5c-4a2d-bdcf-a7d86772f6ac req-3bd17d9c-5517-471a-8584-01ef3c74c5c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d07e598b-0481-4f7e-9957-49cd7dbbac98", "tag": "53b14020-f762-46c1-859f-588cb62cbd07"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:34:34.997447 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-de2385fe-8e5c-4a2d-bdcf-a7d86772f6ac req-3bd17d9c-5517-471a-8584-01ef3c74c5c2 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:34.997891 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-de2385fe-8e5c-4a2d-bdcf-a7d86772f6ac req-3bd17d9c-5517-471a-8584-01ef3c74c5c2 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:35.023477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-de2385fe-8e5c-4a2d-bdcf-a7d86772f6ac req-3bd17d9c-5517-471a-8584-01ef3c74c5c2 service nova] Creating event network-changed:53b14020-f762-46c1-859f-588cb62cbd07 for instance d07e598b-0481-4f7e-9957-49cd7dbbac98 on hv-cinder-84178 May 13 17:34:35.037642 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-de2385fe-8e5c-4a2d-bdcf-a7d86772f6ac req-3bd17d9c-5517-471a-8584-01ef3c74c5c2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056104 May 13 17:34:35.038270 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 541/1093] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:34:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:34:35.301937 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-62ffc6c4-7c46-4401-92cb-47e9403c5e7d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:35.302560 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-62ffc6c4-7c46-4401-92cb-47e9403c5e7d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:35.308641 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-62ffc6c4-7c46-4401-92cb-47e9403c5e7d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:35.309339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-62ffc6c4-7c46-4401-92cb-47e9403c5e7d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:35.310283 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-62ffc6c4-7c46-4401-92cb-47e9403c5e7d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:35.310888 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-62ffc6c4-7c46-4401-92cb-47e9403c5e7d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:35.587494 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-62ffc6c4-7c46-4401-92cb-47e9403c5e7d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:35.595541 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-62ffc6c4-7c46-4401-92cb-47e9403c5e7d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1567 microversion: 2.1 time: 0.298206 May 13 17:34:35.596113 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 553/1094] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:35 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1567 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:36.409195 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6edd181a-0b07-4841-9293-c5946996a643 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:36.409697 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-173a4280-d427-47e4-bef0-f4323ff97d4c req-faf2607a-8984-4947-ad4d-6c2db9b4b7c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d07e598b-0481-4f7e-9957-49cd7dbbac98", "tag": "53b14020-f762-46c1-859f-588cb62cbd07"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:34:36.410069 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6edd181a-0b07-4841-9293-c5946996a643 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:36.416438 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6edd181a-0b07-4841-9293-c5946996a643 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:36.417183 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6edd181a-0b07-4841-9293-c5946996a643 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:36.418046 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6edd181a-0b07-4841-9293-c5946996a643 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:36.418162 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-173a4280-d427-47e4-bef0-f4323ff97d4c req-faf2607a-8984-4947-ad4d-6c2db9b4b7c2 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:36.418544 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-173a4280-d427-47e4-bef0-f4323ff97d4c req-faf2607a-8984-4947-ad4d-6c2db9b4b7c2 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:36.418650 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6edd181a-0b07-4841-9293-c5946996a643 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:36.431160 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-173a4280-d427-47e4-bef0-f4323ff97d4c req-faf2607a-8984-4947-ad4d-6c2db9b4b7c2 service nova] Creating event network-changed:53b14020-f762-46c1-859f-588cb62cbd07 for instance d07e598b-0481-4f7e-9957-49cd7dbbac98 on hv-cinder-84178 May 13 17:34:36.436407 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-173a4280-d427-47e4-bef0-f4323ff97d4c req-faf2607a-8984-4947-ad4d-6c2db9b4b7c2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030374 May 13 17:34:36.437128 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 554/1095] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:34:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:34:36.511153 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.objects.instance [None req-6edd181a-0b07-4841-9293-c5946996a643 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lazy-loading 'services' on Instance uuid d07e598b-0481-4f7e-9957-49cd7dbbac98 {{(pid=117492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:34:36.615310 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-32201dbc-851a-4311-b564-51ace8e8eb15 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:36.616320 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-32201dbc-851a-4311-b564-51ace8e8eb15 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:36.622583 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-32201dbc-851a-4311-b564-51ace8e8eb15 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:36.623039 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-32201dbc-851a-4311-b564-51ace8e8eb15 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:36.623852 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-32201dbc-851a-4311-b564-51ace8e8eb15 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:36.624288 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-32201dbc-851a-4311-b564-51ace8e8eb15 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:36.751070 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6edd181a-0b07-4841-9293-c5946996a643 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98/os-volume_attachments/994b59dd-1be8-42b4-bdf7-5d7c87ff1a16" status: 202 len: 0 microversion: 2.1 time: 0.346175 May 13 17:34:36.753056 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 542/1096] 10.222.0.64 () {58 vars in 1415 bytes} [Fri May 13 17:34:36 2022] DELETE /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98/os-volume_attachments/994b59dd-1be8-42b4-bdf7-5d7c87ff1a16 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:34:36.765417 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d40f023c-0938-4eab-ae69-fb5fe1d9ceba tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:36.766791 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d40f023c-0938-4eab-ae69-fb5fe1d9ceba tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:36.775150 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d40f023c-0938-4eab-ae69-fb5fe1d9ceba tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:36.775932 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d40f023c-0938-4eab-ae69-fb5fe1d9ceba tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:36.776954 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d40f023c-0938-4eab-ae69-fb5fe1d9ceba tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:36.777623 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d40f023c-0938-4eab-ae69-fb5fe1d9ceba tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:36.808742 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d40f023c-0938-4eab-ae69-fb5fe1d9ceba tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049844 May 13 17:34:36.809445 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 543/1097] 10.222.0.64 () {58 vars in 1301 bytes} [Fri May 13 17:34:36 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:34:36.854916 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-32201dbc-851a-4311-b564-51ace8e8eb15 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:36.863700 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-32201dbc-851a-4311-b564-51ace8e8eb15 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1567 microversion: 2.1 time: 0.253946 May 13 17:34:36.866637 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 555/1098] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:36 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1567 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:34:37.821022 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f138bd94-56fe-4031-aec5-8c892f22ab32 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:37.821927 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-f138bd94-56fe-4031-aec5-8c892f22ab32 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:37.828205 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f138bd94-56fe-4031-aec5-8c892f22ab32 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:37.828651 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f138bd94-56fe-4031-aec5-8c892f22ab32 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:37.829405 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f138bd94-56fe-4031-aec5-8c892f22ab32 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:37.829835 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f138bd94-56fe-4031-aec5-8c892f22ab32 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:37.858455 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f138bd94-56fe-4031-aec5-8c892f22ab32 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041803 May 13 17:34:37.859002 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 544/1099] 10.222.0.64 () {58 vars in 1301 bytes} [Fri May 13 17:34:37 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:34:37.884435 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3b3cbc85-1802-46d8-9110-09cef91e0d8b tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:37.885050 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3b3cbc85-1802-46d8-9110-09cef91e0d8b tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:37.891307 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3b3cbc85-1802-46d8-9110-09cef91e0d8b tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:37.891767 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3b3cbc85-1802-46d8-9110-09cef91e0d8b tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:37.892543 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3b3cbc85-1802-46d8-9110-09cef91e0d8b tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:37.892999 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3b3cbc85-1802-46d8-9110-09cef91e0d8b tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:38.026128 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3b3cbc85-1802-46d8-9110-09cef91e0d8b tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:38.033773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3b3cbc85-1802-46d8-9110-09cef91e0d8b tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1567 microversion: 2.1 time: 0.153116 May 13 17:34:38.034403 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 556/1100] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:37 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:38.870466 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3a4d8321-2299-436e-acf2-061d7ba976a9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:38.871421 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3a4d8321-2299-436e-acf2-061d7ba976a9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:38.877902 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3a4d8321-2299-436e-acf2-061d7ba976a9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:38.878333 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3a4d8321-2299-436e-acf2-061d7ba976a9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:38.879106 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3a4d8321-2299-436e-acf2-061d7ba976a9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:38.879577 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3a4d8321-2299-436e-acf2-061d7ba976a9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:38.907143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3a4d8321-2299-436e-acf2-061d7ba976a9 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.040852 May 13 17:34:38.907716 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 545/1101] 10.222.0.64 () {58 vars in 1301 bytes} [Fri May 13 17:34:38 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 17:34:38.918299 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0d99ff49-1816-4c45-bcc3-c2984a634bee tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:38.918795 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0d99ff49-1816-4c45-bcc3-c2984a634bee tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:38.924717 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0d99ff49-1816-4c45-bcc3-c2984a634bee tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:38.925176 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0d99ff49-1816-4c45-bcc3-c2984a634bee tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:38.925947 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0d99ff49-1816-4c45-bcc3-c2984a634bee tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:38.926518 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0d99ff49-1816-4c45-bcc3-c2984a634bee tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:39.004151 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-0d99ff49-1816-4c45-bcc3-c2984a634bee tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] HTTP exception thrown: Instance d07e598b-0481-4f7e-9957-49cd7dbbac98 is not attached to volume 994b59dd-1be8-42b4-bdf7-5d7c87ff1a16 May 13 17:34:39.012899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0d99ff49-1816-4c45-bcc3-c2984a634bee tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Request method failure captured: May 13 17:34:39.012899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: DELETE /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98/os-volume_attachments/994b59dd-1be8-42b4-bdf7-5d7c87ff1a16 HTTP/1.1 May 13 17:34:39.012899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:34:39.012899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:34:39.012899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:34:39.012899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:34:39.012899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:34:39.012899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:34:39.012899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:34:39.012899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:34:39.012899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpVLGXdCsiAG9QdBjRqi-qiKM2vzQYKfbXxN9CZKFMZLaMqBPz6A7xc_g8glTfZvXdkEVbpxp1An8Mv-9lxPiKpKyTQ9jxWCGHShbh0JtOAVZWyLreP6XhUpkJWqUWJHrVuQAmcCl25Jol344uoSJbGe7k05OHyfyftrgLN5Yf8-I7k May 13 17:34:39.012899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:34:39.012899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:34:39.012899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:34:39.012899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:34:39.012899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:34:39.012899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:34:39.012899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: aff066fb75f04eb7bb9b16dea32b270d May 13 17:34:39.012899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-TestMinimumBasicScenario-1034242823 May 13 17:34:39.012899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:34:39.012899 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:34:39.014511 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/aff066fb75f04eb7bb9b16dea32b270d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/aff066fb75f04eb7bb9b16dea32b270d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_aff066fb75f04eb7bb9b16dea32b270d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/aff066fb75f04eb7bb9b16dea32b270d"}]}] May 13 17:34:39.014511 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-TestMinimumBasicScenario-1034242823 May 13 17:34:39.014511 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: aff066fb75f04eb7bb9b16dea32b270d May 13 17:34:39.014511 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1034242823 May 13 17:34:39.014511 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-TestMinimumBasicScenario-1034242823-project May 13 17:34:39.014511 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:34:39.014511 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:34:39.014511 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: bf8f7f47fe6c4a88b415ec21b36fcdd9 May 13 17:34:39.014511 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-TestMinimumBasicScenario-1034242823-project May 13 17:34:39.014511 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: > May 13 17:34:39.014511 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Instance d07e598b-0481-4f7e-9957-49cd7dbbac98 is not attached to volume 994b59dd-1be8-42b4-bdf7-5d7c87ff1a16 May 13 17:34:39.015438 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'server_id': 'd07e598b-0481-4f7e-9957-49cd7dbbac98', 'id': '994b59dd-1be8-42b4-bdf7-5d7c87ff1a16'} May 13 17:34:39.015438 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:34:39.015438 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:34:39.015438 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 13 17:34:39.015438 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 13 17:34:39.015438 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 13 17:34:39.015438 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 13 17:34:39.015438 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 13 17:34:39.015438 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 13 17:34:39.015438 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 994b59dd-1be8-42b4-bdf7-5d7c87ff1a16. May 13 17:34:39.015438 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:34:39.015438 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:34:39.015438 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:34:39.015438 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:34:39.015438 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:34:39.015438 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:34:39.015438 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:34:39.015438 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:34:39.015438 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:34:39.017041 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:34:39.017041 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 13 17:34:39.017041 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 13 17:34:39.017041 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d07e598b-0481-4f7e-9957-49cd7dbbac98 is not attached to volume 994b59dd-1be8-42b4-bdf7-5d7c87ff1a16 May 13 17:34:39.017041 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:34:39.017041 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:34:39.017041 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:34:39.017041 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:34:39.017041 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:34:39.017041 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:34:39.017041 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:34:39.017041 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:34:39.017041 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d07e598b-0481-4f7e-9957-49cd7dbbac98 is not attached to volume 994b59dd-1be8-42b4-bdf7-5d7c87ff1a16 May 13 17:34:39.017041 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:34:39.017041 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0d99ff49-1816-4c45-bcc3-c2984a634bee tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Returning 404 to user: Instance d07e598b-0481-4f7e-9957-49cd7dbbac98 is not attached to volume 994b59dd-1be8-42b4-bdf7-5d7c87ff1a16 {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:34:39.018249 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0d99ff49-1816-4c45-bcc3-c2984a634bee tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98/os-volume_attachments/994b59dd-1be8-42b4-bdf7-5d7c87ff1a16" status: 404 len: 154 microversion: 2.1 time: 0.100357 May 13 17:34:39.018249 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 557/1102] 10.222.0.64 () {58 vars in 1415 bytes} [Fri May 13 17:34:38 2022] DELETE /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98/os-volume_attachments/994b59dd-1be8-42b4-bdf7-5d7c87ff1a16 => generated 154 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:34:39.051420 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-8b4239f0-4241-4e91-bb6a-28eb81267b1c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:39.052030 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-8b4239f0-4241-4e91-bb6a-28eb81267b1c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:39.057818 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8b4239f0-4241-4e91-bb6a-28eb81267b1c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:39.058271 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8b4239f0-4241-4e91-bb6a-28eb81267b1c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:39.059035 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8b4239f0-4241-4e91-bb6a-28eb81267b1c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:39.059544 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8b4239f0-4241-4e91-bb6a-28eb81267b1c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:39.187091 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-8b4239f0-4241-4e91-bb6a-28eb81267b1c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:39.197024 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-8b4239f0-4241-4e91-bb6a-28eb81267b1c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1567 microversion: 2.1 time: 0.147571 May 13 17:34:39.197024 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 546/1103] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:39 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1567 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:40.212600 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8d4b7f19-d5c6-4d1a-ada8-06769e43092e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:40.213209 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8d4b7f19-d5c6-4d1a-ada8-06769e43092e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:40.219877 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8d4b7f19-d5c6-4d1a-ada8-06769e43092e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:40.220280 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8d4b7f19-d5c6-4d1a-ada8-06769e43092e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:40.221026 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8d4b7f19-d5c6-4d1a-ada8-06769e43092e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:40.221456 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8d4b7f19-d5c6-4d1a-ada8-06769e43092e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:40.267408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-724ed0ca-01b1-443b-b6f9-d7a72fa50093 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:40.267980 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-724ed0ca-01b1-443b-b6f9-d7a72fa50093 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:40.274388 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-724ed0ca-01b1-443b-b6f9-d7a72fa50093 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:40.274920 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-724ed0ca-01b1-443b-b6f9-d7a72fa50093 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:40.275807 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-724ed0ca-01b1-443b-b6f9-d7a72fa50093 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:40.276338 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-724ed0ca-01b1-443b-b6f9-d7a72fa50093 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:40.301585 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-724ed0ca-01b1-443b-b6f9-d7a72fa50093 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Going to try to terminate instance {{(pid=117492) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 17:34:40.353965 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8d4b7f19-d5c6-4d1a-ada8-06769e43092e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:40.361303 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8d4b7f19-d5c6-4d1a-ada8-06769e43092e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1567 microversion: 2.1 time: 0.153172 May 13 17:34:40.361861 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 558/1104] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:40 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:40.550819 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-724ed0ca-01b1-443b-b6f9-d7a72fa50093 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 204 len: 0 microversion: 2.1 time: 0.287065 May 13 17:34:40.551473 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 547/1105] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:34:40 2022] DELETE /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 13 17:34:40.559991 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6b186d9e-8cb6-4f59-bfaa-d6a6c3af5475 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:40.561485 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6b186d9e-8cb6-4f59-bfaa-d6a6c3af5475 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:40.566407 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b186d9e-8cb6-4f59-bfaa-d6a6c3af5475 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:40.566897 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b186d9e-8cb6-4f59-bfaa-d6a6c3af5475 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:40.567699 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b186d9e-8cb6-4f59-bfaa-d6a6c3af5475 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:40.568137 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6b186d9e-8cb6-4f59-bfaa-d6a6c3af5475 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:40.693773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6b186d9e-8cb6-4f59-bfaa-d6a6c3af5475 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:40.701023 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6b186d9e-8cb6-4f59-bfaa-d6a6c3af5475 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1555 microversion: 2.1 time: 0.144846 May 13 17:34:40.701582 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 559/1106] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:40 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1555 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:41.382106 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-e70ac896-af46-4232-ac7f-68e31b9af622 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:41.382823 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-e70ac896-af46-4232-ac7f-68e31b9af622 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:41.389219 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e70ac896-af46-4232-ac7f-68e31b9af622 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:41.389659 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e70ac896-af46-4232-ac7f-68e31b9af622 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:41.390419 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e70ac896-af46-4232-ac7f-68e31b9af622 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:41.390845 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e70ac896-af46-4232-ac7f-68e31b9af622 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:41.519822 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-e70ac896-af46-4232-ac7f-68e31b9af622 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:41.527718 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-e70ac896-af46-4232-ac7f-68e31b9af622 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1567 microversion: 2.1 time: 0.150424 May 13 17:34:41.528292 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 548/1107] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:41 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:41.717895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2923c482-d129-469f-8ed2-0710f79aa794 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:41.718419 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2923c482-d129-469f-8ed2-0710f79aa794 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:41.724829 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2923c482-d129-469f-8ed2-0710f79aa794 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:41.725971 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2923c482-d129-469f-8ed2-0710f79aa794 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:41.726749 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2923c482-d129-469f-8ed2-0710f79aa794 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:41.727200 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2923c482-d129-469f-8ed2-0710f79aa794 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:41.855058 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2923c482-d129-469f-8ed2-0710f79aa794 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:41.862319 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2923c482-d129-469f-8ed2-0710f79aa794 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1555 microversion: 2.1 time: 0.148383 May 13 17:34:41.862890 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 560/1108] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:41 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:42.543751 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3f56c37d-9782-47d3-a7be-ba5539f67910 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:42.544358 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3f56c37d-9782-47d3-a7be-ba5539f67910 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:42.550514 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3f56c37d-9782-47d3-a7be-ba5539f67910 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:42.550960 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3f56c37d-9782-47d3-a7be-ba5539f67910 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:42.551804 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3f56c37d-9782-47d3-a7be-ba5539f67910 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:42.552240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3f56c37d-9782-47d3-a7be-ba5539f67910 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:42.685515 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3f56c37d-9782-47d3-a7be-ba5539f67910 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:42.693718 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3f56c37d-9782-47d3-a7be-ba5539f67910 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1567 microversion: 2.1 time: 0.153741 May 13 17:34:42.695204 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 549/1109] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:42 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:42.879422 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-165e8ceb-8b10-4d57-9ca2-fac4107f79d3 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:42.880038 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-165e8ceb-8b10-4d57-9ca2-fac4107f79d3 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:42.886487 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-165e8ceb-8b10-4d57-9ca2-fac4107f79d3 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:42.886943 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-165e8ceb-8b10-4d57-9ca2-fac4107f79d3 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:42.887741 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-165e8ceb-8b10-4d57-9ca2-fac4107f79d3 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:42.888179 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-165e8ceb-8b10-4d57-9ca2-fac4107f79d3 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:43.020552 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-165e8ceb-8b10-4d57-9ca2-fac4107f79d3 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:43.027873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-165e8ceb-8b10-4d57-9ca2-fac4107f79d3 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1555 microversion: 2.1 time: 0.152533 May 13 17:34:43.028474 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 561/1110] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:42 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:43.712441 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-5f862551-133f-4f16-a8bd-b23cac331108 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:43.713069 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-5f862551-133f-4f16-a8bd-b23cac331108 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:43.719713 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5f862551-133f-4f16-a8bd-b23cac331108 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:43.720135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5f862551-133f-4f16-a8bd-b23cac331108 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:43.720917 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5f862551-133f-4f16-a8bd-b23cac331108 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:43.721356 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5f862551-133f-4f16-a8bd-b23cac331108 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:43.826792 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-7541ea80-f657-4554-86fa-48d4d610298e req-5792b69f-0d14-4b60-be3a-de44a981f71c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d07e598b-0481-4f7e-9957-49cd7dbbac98", "name": "network-vif-deleted", "tag": "53b14020-f762-46c1-859f-588cb62cbd07"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:34:43.835592 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-7541ea80-f657-4554-86fa-48d4d610298e req-5792b69f-0d14-4b60-be3a-de44a981f71c service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:43.836123 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-7541ea80-f657-4554-86fa-48d4d610298e req-5792b69f-0d14-4b60-be3a-de44a981f71c service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:43.848088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-7541ea80-f657-4554-86fa-48d4d610298e req-5792b69f-0d14-4b60-be3a-de44a981f71c service nova] Creating event network-vif-deleted:53b14020-f762-46c1-859f-588cb62cbd07 for instance d07e598b-0481-4f7e-9957-49cd7dbbac98 on hv-cinder-84178 May 13 17:34:43.853418 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-7541ea80-f657-4554-86fa-48d4d610298e req-5792b69f-0d14-4b60-be3a-de44a981f71c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030314 May 13 17:34:43.854419 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 562/1111] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:34:43.876892 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-5f862551-133f-4f16-a8bd-b23cac331108 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:43.885347 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-5f862551-133f-4f16-a8bd-b23cac331108 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1568 microversion: 2.1 time: 0.177467 May 13 17:34:43.885919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 550/1112] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:43 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:34:43.903620 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-514599ed-ea00-45fb-a57a-e4ec50f736de tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:34:43.904224 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-514599ed-ea00-45fb-a57a-e4ec50f736de tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:43.910308 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-514599ed-ea00-45fb-a57a-e4ec50f736de tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:43.910763 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-514599ed-ea00-45fb-a57a-e4ec50f736de tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:43.911566 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-514599ed-ea00-45fb-a57a-e4ec50f736de tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:43.912003 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-514599ed-ea00-45fb-a57a-e4ec50f736de tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:43.927645 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-f7394ae4-ba67-4d4c-b941-3db4c463cb0f req-9e1da45e-e5ed-4581-b0a4-43e4e6bb45fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a310844-e208-4f17-a8c9-fd4db4acf00d", "name": "network-vif-unplugged", "status": "completed", "tag": "f37d13dd-347a-41e2-8ca5-2b0f1df46c9c"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:34:43.937620 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-f7394ae4-ba67-4d4c-b941-3db4c463cb0f req-9e1da45e-e5ed-4581-b0a4-43e4e6bb45fb service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:43.938076 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-f7394ae4-ba67-4d4c-b941-3db4c463cb0f req-9e1da45e-e5ed-4581-b0a4-43e4e6bb45fb service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:43.949062 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-f7394ae4-ba67-4d4c-b941-3db4c463cb0f req-9e1da45e-e5ed-4581-b0a4-43e4e6bb45fb service nova] Creating event network-vif-unplugged:f37d13dd-347a-41e2-8ca5-2b0f1df46c9c for instance 7a310844-e208-4f17-a8c9-fd4db4acf00d on hv-cinder-84178 May 13 17:34:43.953955 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-f7394ae4-ba67-4d4c-b941-3db4c463cb0f req-9e1da45e-e5ed-4581-b0a4-43e4e6bb45fb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030835 May 13 17:34:43.955045 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 551/1113] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:34:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:34:44.046028 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-af47ad70-ce1c-4aa2-9d27-36ce89b51821 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:44.046750 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-af47ad70-ce1c-4aa2-9d27-36ce89b51821 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:44.053388 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-af47ad70-ce1c-4aa2-9d27-36ce89b51821 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:44.058680 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-af47ad70-ce1c-4aa2-9d27-36ce89b51821 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:44.058680 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-af47ad70-ce1c-4aa2-9d27-36ce89b51821 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:44.058680 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-af47ad70-ce1c-4aa2-9d27-36ce89b51821 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:44.120229 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-af47ad70-ce1c-4aa2-9d27-36ce89b51821 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:44.129342 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-af47ad70-ce1c-4aa2-9d27-36ce89b51821 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1513 microversion: 2.1 time: 0.088150 May 13 17:34:44.129933 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 552/1114] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:44 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1513 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:34:44.143219 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-514599ed-ea00-45fb-a57a-e4ec50f736de tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "POST /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d/action" status: 202 len: 0 microversion: 2.1 time: 0.244034 May 13 17:34:44.143866 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 563/1115] 10.222.0.64 () {60 vars in 1277 bytes} [Fri May 13 17:34:43 2022] POST /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d/action => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:34:44.153337 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-bbe5b6fa-43c7-4ed7-b6b7-9bb18191317f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:44.154032 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-bbe5b6fa-43c7-4ed7-b6b7-9bb18191317f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:44.160039 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bbe5b6fa-43c7-4ed7-b6b7-9bb18191317f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:44.161094 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bbe5b6fa-43c7-4ed7-b6b7-9bb18191317f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:44.161887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bbe5b6fa-43c7-4ed7-b6b7-9bb18191317f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:44.162324 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bbe5b6fa-43c7-4ed7-b6b7-9bb18191317f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:44.341706 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-bbe5b6fa-43c7-4ed7-b6b7-9bb18191317f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:44.349080 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-bbe5b6fa-43c7-4ed7-b6b7-9bb18191317f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1576 microversion: 2.1 time: 0.200305 May 13 17:34:44.349652 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 553/1116] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:44 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1576 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:34:45.146017 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-30e960e4-aba0-47e4-a96f-2a95b0503496 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:45.146636 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-30e960e4-aba0-47e4-a96f-2a95b0503496 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:45.153125 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-30e960e4-aba0-47e4-a96f-2a95b0503496 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:45.153578 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-30e960e4-aba0-47e4-a96f-2a95b0503496 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:45.154343 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-30e960e4-aba0-47e4-a96f-2a95b0503496 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:45.154783 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-30e960e4-aba0-47e4-a96f-2a95b0503496 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:45.183912 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-30e960e4-aba0-47e4-a96f-2a95b0503496 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:45.184364 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-30e960e4-aba0-47e4-a96f-2a95b0503496 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:45.184816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-30e960e4-aba0-47e4-a96f-2a95b0503496 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lazy-loading 'fault' on Instance uuid d07e598b-0481-4f7e-9957-49cd7dbbac98 {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:34:45.224431 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-30e960e4-aba0-47e4-a96f-2a95b0503496 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bf8f7f47fe6c4a88b415ec21b36fcdd9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aff066fb75f04eb7bb9b16dea32b270d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:45.231827 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-30e960e4-aba0-47e4-a96f-2a95b0503496 tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 200 len: 1349 microversion: 2.1 time: 0.090189 May 13 17:34:45.232384 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 564/1117] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:45 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 1349 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:45.366063 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-4dd07950-c98b-4c1f-a9c0-cd0dcc9b7265 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:45.366682 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-4dd07950-c98b-4c1f-a9c0-cd0dcc9b7265 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:45.373113 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4dd07950-c98b-4c1f-a9c0-cd0dcc9b7265 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:45.373567 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4dd07950-c98b-4c1f-a9c0-cd0dcc9b7265 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:45.374338 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4dd07950-c98b-4c1f-a9c0-cd0dcc9b7265 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:45.374781 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4dd07950-c98b-4c1f-a9c0-cd0dcc9b7265 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:45.508462 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-4dd07950-c98b-4c1f-a9c0-cd0dcc9b7265 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:45.519293 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-4dd07950-c98b-4c1f-a9c0-cd0dcc9b7265 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1518 microversion: 2.1 time: 0.153782 May 13 17:34:45.519293 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 554/1118] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:45 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1518 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:46.249648 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0e55f2d6-f8a6-427d-b8f5-4463eac5f8cb tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:46.250189 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0e55f2d6-f8a6-427d-b8f5-4463eac5f8cb tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] [instance: d07e598b-0481-4f7e-9957-49cd7dbbac98] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:46.256616 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0e55f2d6-f8a6-427d-b8f5-4463eac5f8cb tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:46.257075 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0e55f2d6-f8a6-427d-b8f5-4463eac5f8cb tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:46.257856 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0e55f2d6-f8a6-427d-b8f5-4463eac5f8cb tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:46.258301 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0e55f2d6-f8a6-427d-b8f5-4463eac5f8cb tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:46.272331 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-0e55f2d6-f8a6-427d-b8f5-4463eac5f8cb tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] HTTP exception thrown: Instance d07e598b-0481-4f7e-9957-49cd7dbbac98 could not be found. May 13 17:34:46.274044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0e55f2d6-f8a6-427d-b8f5-4463eac5f8cb tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Request method failure captured: May 13 17:34:46.274044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 HTTP/1.1 May 13 17:34:46.274044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:34:46.274044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:34:46.274044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:34:46.274044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:34:46.274044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:34:46.274044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:34:46.274044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:34:46.274044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:34:46.274044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpVLGXdCsiAG9QdBjRqi-qiKM2vzQYKfbXxN9CZKFMZLaMqBPz6A7xc_g8glTfZvXdkEVbpxp1An8Mv-9lxPiKpKyTQ9jxWCGHShbh0JtOAVZWyLreP6XhUpkJWqUWJHrVuQAmcCl25Jol344uoSJbGe7k05OHyfyftrgLN5Yf8-I7k May 13 17:34:46.274044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:34:46.274044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:34:46.274044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:34:46.274044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:34:46.274044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:34:46.274044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:34:46.274044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: aff066fb75f04eb7bb9b16dea32b270d May 13 17:34:46.274044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-TestMinimumBasicScenario-1034242823 May 13 17:34:46.274044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:34:46.274044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:34:46.275572 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/aff066fb75f04eb7bb9b16dea32b270d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/aff066fb75f04eb7bb9b16dea32b270d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_aff066fb75f04eb7bb9b16dea32b270d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/aff066fb75f04eb7bb9b16dea32b270d"}]}] May 13 17:34:46.275572 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-TestMinimumBasicScenario-1034242823 May 13 17:34:46.275572 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: aff066fb75f04eb7bb9b16dea32b270d May 13 17:34:46.275572 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1034242823 May 13 17:34:46.275572 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-TestMinimumBasicScenario-1034242823-project May 13 17:34:46.275572 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:34:46.275572 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:34:46.275572 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: bf8f7f47fe6c4a88b415ec21b36fcdd9 May 13 17:34:46.275572 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-TestMinimumBasicScenario-1034242823-project May 13 17:34:46.275572 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: > May 13 17:34:46.275572 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Instance d07e598b-0481-4f7e-9957-49cd7dbbac98 could not be found. May 13 17:34:46.275572 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'id': 'd07e598b-0481-4f7e-9957-49cd7dbbac98'} May 13 17:34:46.276488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:34:46.276488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:34:46.276488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:34:46.276488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:34:46.276488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:34:46.276488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:34:46.276488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:34:46.276488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:34:46.276488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:34:46.276488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:34:46.276488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d07e598b-0481-4f7e-9957-49cd7dbbac98 could not be found. May 13 17:34:46.276488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:34:46.276488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:34:46.276488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:34:46.276488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:34:46.276488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:34:46.276488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:34:46.276488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:34:46.276488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:34:46.276488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:34:46.277958 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:34:46.277958 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:34:46.277958 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:34:46.277958 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:34:46.277958 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:34:46.277958 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:34:46.277958 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:34:46.277958 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d07e598b-0481-4f7e-9957-49cd7dbbac98 could not be found. May 13 17:34:46.277958 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:34:46.277958 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:34:46.277958 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:34:46.277958 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:34:46.277958 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:34:46.277958 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:34:46.277958 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:34:46.277958 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:34:46.277958 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d07e598b-0481-4f7e-9957-49cd7dbbac98 could not be found. May 13 17:34:46.277958 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:34:46.280010 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0e55f2d6-f8a6-427d-b8f5-4463eac5f8cb tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Returning 404 to user: Instance d07e598b-0481-4f7e-9957-49cd7dbbac98 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:34:46.280010 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0e55f2d6-f8a6-427d-b8f5-4463eac5f8cb tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98" status: 404 len: 111 microversion: 2.1 time: 0.029912 May 13 17:34:46.280010 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 565/1119] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:46 2022] GET /compute/v2.1/servers/d07e598b-0481-4f7e-9957-49cd7dbbac98 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 17:34:46.287921 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f6de8ae4-7ca0-435b-b2d0-1a6b3cdf9c0e tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] Calling method '.version_select at 0x7fa084a4bdc0>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:46.373689 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f6de8ae4-7ca0-435b-b2d0-1a6b3cdf9c0e tempest-TestMinimumBasicScenario-1034242823 tempest-TestMinimumBasicScenario-1034242823-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1325480932" status: 202 len: 0 microversion: 2.1 time: 0.089830 May 13 17:34:46.377930 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 555/1120] 10.222.0.64 () {58 vars in 1271 bytes} [Fri May 13 17:34:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1325480932 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:34:46.534321 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-70f1ea6f-41a4-4e04-9de2-11cd3f2c80a9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:46.534994 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-70f1ea6f-41a4-4e04-9de2-11cd3f2c80a9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:46.541727 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-70f1ea6f-41a4-4e04-9de2-11cd3f2c80a9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:46.542197 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-70f1ea6f-41a4-4e04-9de2-11cd3f2c80a9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:46.542968 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-70f1ea6f-41a4-4e04-9de2-11cd3f2c80a9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:46.543434 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-70f1ea6f-41a4-4e04-9de2-11cd3f2c80a9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:46.769169 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-70f1ea6f-41a4-4e04-9de2-11cd3f2c80a9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:46.777657 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-70f1ea6f-41a4-4e04-9de2-11cd3f2c80a9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1518 microversion: 2.1 time: 0.247729 May 13 17:34:46.778235 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 566/1121] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:46 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1518 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:47.794183 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-0884da55-ac9d-4cf4-a250-2525575fb889 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:47.794873 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-0884da55-ac9d-4cf4-a250-2525575fb889 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:47.801547 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0884da55-ac9d-4cf4-a250-2525575fb889 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:47.802060 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0884da55-ac9d-4cf4-a250-2525575fb889 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:47.802830 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0884da55-ac9d-4cf4-a250-2525575fb889 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:47.803295 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0884da55-ac9d-4cf4-a250-2525575fb889 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:47.933974 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0884da55-ac9d-4cf4-a250-2525575fb889 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:47.941996 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-0884da55-ac9d-4cf4-a250-2525575fb889 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1574 microversion: 2.1 time: 0.152197 May 13 17:34:47.942700 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 556/1122] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:47 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:48.960095 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-dfc8b851-ce0a-4faa-bc3a-023c7932dd2f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:48.960823 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-dfc8b851-ce0a-4faa-bc3a-023c7932dd2f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:48.968132 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dfc8b851-ce0a-4faa-bc3a-023c7932dd2f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:48.968674 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dfc8b851-ce0a-4faa-bc3a-023c7932dd2f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:48.969505 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dfc8b851-ce0a-4faa-bc3a-023c7932dd2f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:48.970005 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-dfc8b851-ce0a-4faa-bc3a-023c7932dd2f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:49.155356 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-dfc8b851-ce0a-4faa-bc3a-023c7932dd2f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:49.162737 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-dfc8b851-ce0a-4faa-bc3a-023c7932dd2f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1574 microversion: 2.1 time: 0.206779 May 13 17:34:49.163399 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 567/1123] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:48 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1574 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:50.180821 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-84924999-04d0-4f20-9690-b5b364795074 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:50.181392 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-84924999-04d0-4f20-9690-b5b364795074 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:50.188476 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-84924999-04d0-4f20-9690-b5b364795074 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:50.188923 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-84924999-04d0-4f20-9690-b5b364795074 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:50.189707 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-84924999-04d0-4f20-9690-b5b364795074 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:50.190159 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-84924999-04d0-4f20-9690-b5b364795074 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:50.444773 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-84924999-04d0-4f20-9690-b5b364795074 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:50.452683 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-84924999-04d0-4f20-9690-b5b364795074 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1574 microversion: 2.1 time: 0.276522 May 13 17:34:50.453255 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 557/1124] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:50 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1574 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:51.470801 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3db2fc7a-b207-49a2-b17b-36798ba06422 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:51.478098 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3db2fc7a-b207-49a2-b17b-36798ba06422 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:51.484993 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3db2fc7a-b207-49a2-b17b-36798ba06422 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:51.485448 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3db2fc7a-b207-49a2-b17b-36798ba06422 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:51.486250 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3db2fc7a-b207-49a2-b17b-36798ba06422 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:51.486682 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3db2fc7a-b207-49a2-b17b-36798ba06422 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:51.713936 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3db2fc7a-b207-49a2-b17b-36798ba06422 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:51.724246 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3db2fc7a-b207-49a2-b17b-36798ba06422 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1574 microversion: 2.1 time: 0.258131 May 13 17:34:51.734629 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 568/1125] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:51 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1574 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:52.741461 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d3aaeb5e-850a-4c82-993c-af0d30e257f6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:52.742078 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d3aaeb5e-850a-4c82-993c-af0d30e257f6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:52.748420 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d3aaeb5e-850a-4c82-993c-af0d30e257f6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:52.748875 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d3aaeb5e-850a-4c82-993c-af0d30e257f6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:52.749785 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d3aaeb5e-850a-4c82-993c-af0d30e257f6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:52.750233 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d3aaeb5e-850a-4c82-993c-af0d30e257f6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:52.961753 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d3aaeb5e-850a-4c82-993c-af0d30e257f6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:52.970123 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d3aaeb5e-850a-4c82-993c-af0d30e257f6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1574 microversion: 2.1 time: 0.232531 May 13 17:34:52.970700 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 558/1126] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:52 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1574 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:53.988163 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c6693411-3e85-4d2e-8318-196823e71452 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:53.989626 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c6693411-3e85-4d2e-8318-196823e71452 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:53.998993 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c6693411-3e85-4d2e-8318-196823e71452 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:53.999734 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c6693411-3e85-4d2e-8318-196823e71452 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:54.000522 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c6693411-3e85-4d2e-8318-196823e71452 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:54.000969 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c6693411-3e85-4d2e-8318-196823e71452 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:54.136953 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c6693411-3e85-4d2e-8318-196823e71452 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:54.145123 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c6693411-3e85-4d2e-8318-196823e71452 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1574 microversion: 2.1 time: 0.160945 May 13 17:34:54.146002 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 569/1127] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:53 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:55.161877 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-02b7dfdb-3d57-4193-ae99-0e0259b3a81f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:55.162491 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-02b7dfdb-3d57-4193-ae99-0e0259b3a81f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:55.168885 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-02b7dfdb-3d57-4193-ae99-0e0259b3a81f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:55.169344 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-02b7dfdb-3d57-4193-ae99-0e0259b3a81f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:55.170138 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-02b7dfdb-3d57-4193-ae99-0e0259b3a81f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:55.170579 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-02b7dfdb-3d57-4193-ae99-0e0259b3a81f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:55.404183 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-02b7dfdb-3d57-4193-ae99-0e0259b3a81f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:55.412539 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-02b7dfdb-3d57-4193-ae99-0e0259b3a81f tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1574 microversion: 2.1 time: 0.254537 May 13 17:34:55.414813 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 559/1128] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:55 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1574 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:55.897309 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-db338717-b084-4211-9c73-7b8e8ba5ad10 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:55.898839 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-db338717-b084-4211-9c73-7b8e8ba5ad10 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:55.906960 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-db338717-b084-4211-9c73-7b8e8ba5ad10 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:55.907635 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-db338717-b084-4211-9c73-7b8e8ba5ad10 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:55.919191 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-db338717-b084-4211-9c73-7b8e8ba5ad10 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:55.919672 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-db338717-b084-4211-9c73-7b8e8ba5ad10 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:55.963676 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-db338717-b084-4211-9c73-7b8e8ba5ad10 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070184 May 13 17:34:55.964307 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 570/1129] 10.222.0.64 () {58 vars in 1301 bytes} [Fri May 13 17:34:55 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48/os-volume_attachments => generated 25 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 17:34:56.022862 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a4094df2-ecf7-4f81-b5cb-fc47ea702af9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:56.023395 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a4094df2-ecf7-4f81-b5cb-fc47ea702af9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:56.029644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a4094df2-ecf7-4f81-b5cb-fc47ea702af9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:56.030097 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a4094df2-ecf7-4f81-b5cb-fc47ea702af9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:56.030889 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a4094df2-ecf7-4f81-b5cb-fc47ea702af9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:56.031367 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a4094df2-ecf7-4f81-b5cb-fc47ea702af9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:56.056335 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a4094df2-ecf7-4f81-b5cb-fc47ea702af9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Going to try to terminate instance {{(pid=117492) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 17:34:56.390606 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a4094df2-ecf7-4f81-b5cb-fc47ea702af9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "DELETE /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 204 len: 0 microversion: 2.1 time: 0.371230 May 13 17:34:56.391318 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 560/1130] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:34:56 2022] DELETE /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 17:34:56.399487 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-61fa4d8a-ef40-4011-9591-54f642550483 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:56.400498 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-61fa4d8a-ef40-4011-9591-54f642550483 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:56.406134 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61fa4d8a-ef40-4011-9591-54f642550483 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:56.406587 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61fa4d8a-ef40-4011-9591-54f642550483 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:56.407391 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61fa4d8a-ef40-4011-9591-54f642550483 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:56.407833 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61fa4d8a-ef40-4011-9591-54f642550483 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:56.433738 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-9337ab51-5c40-45e6-86f9-8cdddecd83ac tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:56.434565 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-9337ab51-5c40-45e6-86f9-8cdddecd83ac tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:56.441557 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9337ab51-5c40-45e6-86f9-8cdddecd83ac tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:56.442085 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9337ab51-5c40-45e6-86f9-8cdddecd83ac tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:56.442939 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9337ab51-5c40-45e6-86f9-8cdddecd83ac tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:56.443581 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9337ab51-5c40-45e6-86f9-8cdddecd83ac tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:56.539184 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-61fa4d8a-ef40-4011-9591-54f642550483 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:56.547115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-61fa4d8a-ef40-4011-9591-54f642550483 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1674 microversion: 2.1 time: 0.151444 May 13 17:34:56.547718 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 571/1131] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:56 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:56.579013 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-9337ab51-5c40-45e6-86f9-8cdddecd83ac tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:56.587787 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-9337ab51-5c40-45e6-86f9-8cdddecd83ac tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1574 microversion: 2.1 time: 0.161304 May 13 17:34:56.591855 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 561/1132] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:56 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1574 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:34:57.566126 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3178d7b6-f0e0-451c-9540-2b38816f432c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:57.566820 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3178d7b6-f0e0-451c-9540-2b38816f432c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:57.573784 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3178d7b6-f0e0-451c-9540-2b38816f432c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:57.574236 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3178d7b6-f0e0-451c-9540-2b38816f432c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:57.575066 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3178d7b6-f0e0-451c-9540-2b38816f432c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:57.575573 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3178d7b6-f0e0-451c-9540-2b38816f432c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:57.605424 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-347f377b-82e5-4c6e-a4ae-c7a2874315dd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:57.606192 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-347f377b-82e5-4c6e-a4ae-c7a2874315dd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:57.612721 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-347f377b-82e5-4c6e-a4ae-c7a2874315dd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:57.613235 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-347f377b-82e5-4c6e-a4ae-c7a2874315dd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:57.616547 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-347f377b-82e5-4c6e-a4ae-c7a2874315dd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:57.616547 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-347f377b-82e5-4c6e-a4ae-c7a2874315dd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:57.726745 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3178d7b6-f0e0-451c-9540-2b38816f432c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:57.736234 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3178d7b6-f0e0-451c-9540-2b38816f432c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1674 microversion: 2.1 time: 0.173927 May 13 17:34:57.737004 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 572/1133] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:57 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1674 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:57.762276 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-347f377b-82e5-4c6e-a4ae-c7a2874315dd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:57.770027 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-347f377b-82e5-4c6e-a4ae-c7a2874315dd tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1574 microversion: 2.1 time: 0.169228 May 13 17:34:57.780122 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 562/1134] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:57 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1574 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:34:58.753671 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3c491b77-4263-496e-b757-f908d757d004 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:58.754186 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3c491b77-4263-496e-b757-f908d757d004 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:58.766976 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3c491b77-4263-496e-b757-f908d757d004 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:58.767435 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3c491b77-4263-496e-b757-f908d757d004 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:58.769667 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3c491b77-4263-496e-b757-f908d757d004 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:58.770159 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3c491b77-4263-496e-b757-f908d757d004 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:58.787830 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-58d6852a-ca7f-42a9-a205-d8d9d3dfd748 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:58.788439 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-58d6852a-ca7f-42a9-a205-d8d9d3dfd748 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:58.801684 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-58d6852a-ca7f-42a9-a205-d8d9d3dfd748 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:58.802433 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-58d6852a-ca7f-42a9-a205-d8d9d3dfd748 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:58.803466 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-58d6852a-ca7f-42a9-a205-d8d9d3dfd748 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:58.806066 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-58d6852a-ca7f-42a9-a205-d8d9d3dfd748 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:58.913487 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3c491b77-4263-496e-b757-f908d757d004 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:58.923120 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3c491b77-4263-496e-b757-f908d757d004 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1606 microversion: 2.1 time: 0.173788 May 13 17:34:58.933714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 573/1135] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:58 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1606 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:34:58.980881 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-58d6852a-ca7f-42a9-a205-d8d9d3dfd748 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:34:58.982967 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-58d6852a-ca7f-42a9-a205-d8d9d3dfd748 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1574 microversion: 2.1 time: 0.199176 May 13 17:34:58.992120 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 563/1136] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:58 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1574 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:34:59.123046 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-ce93b4a1-90f0-4421-a591-08b21fb2ab70 req-b82f88d8-1ff7-4789-982e-1533b2381916 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a72fdd8-ca24-4ae1-b007-7e22f411ad48", "name": "network-vif-deleted", "tag": "65e4c296-6b3c-4eb9-a923-4c5f6eab3710"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:34:59.131824 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-ce93b4a1-90f0-4421-a591-08b21fb2ab70 req-b82f88d8-1ff7-4789-982e-1533b2381916 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:59.132264 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-ce93b4a1-90f0-4421-a591-08b21fb2ab70 req-b82f88d8-1ff7-4789-982e-1533b2381916 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:59.143984 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-ce93b4a1-90f0-4421-a591-08b21fb2ab70 req-b82f88d8-1ff7-4789-982e-1533b2381916 service nova] Creating event network-vif-deleted:65e4c296-6b3c-4eb9-a923-4c5f6eab3710 for instance 9a72fdd8-ca24-4ae1-b007-7e22f411ad48 on hv-cinder-84178 May 13 17:34:59.150432 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-ce93b4a1-90f0-4421-a591-08b21fb2ab70 req-b82f88d8-1ff7-4789-982e-1533b2381916 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030260 May 13 17:34:59.150432 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 574/1137] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:34:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:34:59.940367 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7cdab9dd-e26b-4386-86cb-93b3e1cf7b3a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:34:59.941159 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7cdab9dd-e26b-4386-86cb-93b3e1cf7b3a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:34:59.947749 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7cdab9dd-e26b-4386-86cb-93b3e1cf7b3a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:59.951356 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7cdab9dd-e26b-4386-86cb-93b3e1cf7b3a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:59.951356 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7cdab9dd-e26b-4386-86cb-93b3e1cf7b3a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:59.951356 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7cdab9dd-e26b-4386-86cb-93b3e1cf7b3a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:59.986712 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7cdab9dd-e26b-4386-86cb-93b3e1cf7b3a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:34:59.987194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7cdab9dd-e26b-4386-86cb-93b3e1cf7b3a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:34:59.987664 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.objects.instance [None req-7cdab9dd-e26b-4386-86cb-93b3e1cf7b3a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lazy-loading 'fault' on Instance uuid 9a72fdd8-ca24-4ae1-b007-7e22f411ad48 {{(pid=117492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:35:00.001897 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ebbdb184-5a04-4a23-ab6b-2d2795797af9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:00.003640 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ebbdb184-5a04-4a23-ab6b-2d2795797af9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:00.011601 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ebbdb184-5a04-4a23-ab6b-2d2795797af9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:00.012055 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ebbdb184-5a04-4a23-ab6b-2d2795797af9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:00.012853 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ebbdb184-5a04-4a23-ab6b-2d2795797af9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:00.013483 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ebbdb184-5a04-4a23-ab6b-2d2795797af9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:00.038726 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7cdab9dd-e26b-4386-86cb-93b3e1cf7b3a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:00.046598 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7cdab9dd-e26b-4386-86cb-93b3e1cf7b3a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 200 len: 1328 microversion: 2.1 time: 0.110232 May 13 17:35:00.048001 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 564/1138] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:59 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 1328 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:00.166929 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ebbdb184-5a04-4a23-ab6b-2d2795797af9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:00.179939 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ebbdb184-5a04-4a23-ab6b-2d2795797af9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1574 microversion: 2.1 time: 0.181677 May 13 17:35:00.190682 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 575/1139] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:34:59 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1574 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:00.339265 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-92428da7-b553-4053-8865-aece20afd38d req-67425e80-9edd-48df-8542-4234b3738736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a310844-e208-4f17-a8c9-fd4db4acf00d", "name": "network-vif-plugged", "status": "completed", "tag": "f37d13dd-347a-41e2-8ca5-2b0f1df46c9c"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:35:00.347262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-92428da7-b553-4053-8865-aece20afd38d req-67425e80-9edd-48df-8542-4234b3738736 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:00.347844 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-92428da7-b553-4053-8865-aece20afd38d req-67425e80-9edd-48df-8542-4234b3738736 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:00.360228 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-92428da7-b553-4053-8865-aece20afd38d req-67425e80-9edd-48df-8542-4234b3738736 service nova] Creating event network-vif-plugged:f37d13dd-347a-41e2-8ca5-2b0f1df46c9c for instance 7a310844-e208-4f17-a8c9-fd4db4acf00d on hv-cinder-84178 May 13 17:35:00.370042 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-92428da7-b553-4053-8865-aece20afd38d req-67425e80-9edd-48df-8542-4234b3738736 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035138 May 13 17:35:00.370983 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 565/1140] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:35:01.068558 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4f47b58d-c9fc-42b4-a9aa-823b28f8458d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:01.069791 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4f47b58d-c9fc-42b4-a9aa-823b28f8458d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:01.077075 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4f47b58d-c9fc-42b4-a9aa-823b28f8458d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:01.077530 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4f47b58d-c9fc-42b4-a9aa-823b28f8458d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:01.078328 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4f47b58d-c9fc-42b4-a9aa-823b28f8458d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:01.078768 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4f47b58d-c9fc-42b4-a9aa-823b28f8458d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:01.093529 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-4f47b58d-c9fc-42b4-a9aa-823b28f8458d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] HTTP exception thrown: Instance 9a72fdd8-ca24-4ae1-b007-7e22f411ad48 could not be found. May 13 17:35:01.095232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4f47b58d-c9fc-42b4-a9aa-823b28f8458d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Request method failure captured: May 13 17:35:01.095232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 HTTP/1.1 May 13 17:35:01.095232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:35:01.095232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:35:01.095232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:35:01.095232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:35:01.095232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:35:01.095232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:35:01.095232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:35:01.095232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:35:01.095232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpTdLnBC38r4Fsk9gF4Q-qgew3N3xjHhysfU0GZ-tBIod1vsC397_Sdc9w8yS8dTL3JtngECr8kriEYGXb2K57w2zELiJFXMiTm7t-oES09p5xGMFJ4DBpSXhYJTVYXQuAVegMjasycGrLXLNpygd-WetdBy4ZYTGGIVOgqJHlQUF5Y May 13 17:35:01.095232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:35:01.095232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:35:01.095232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:35:01.095232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:35:01.095232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:35:01.095232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:35:01.095232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: f8e7b818f3a74fc48f0faeeb3398069a May 13 17:35:01.095232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-AttachVolumeTestJSON-878348621 May 13 17:35:01.095232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:35:01.095232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:35:01.096801 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f8e7b818f3a74fc48f0faeeb3398069a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f8e7b818f3a74fc48f0faeeb3398069a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f8e7b818f3a74fc48f0faeeb3398069a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f8e7b818f3a74fc48f0faeeb3398069a"}]}] May 13 17:35:01.096801 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-AttachVolumeTestJSON-878348621 May 13 17:35:01.096801 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: f8e7b818f3a74fc48f0faeeb3398069a May 13 17:35:01.096801 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-AttachVolumeTestJSON-878348621 May 13 17:35:01.096801 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-AttachVolumeTestJSON-878348621-project May 13 17:35:01.096801 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:35:01.096801 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:35:01.096801 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: efc23cbdbebc423baed1a2cb6c6cd7e7 May 13 17:35:01.096801 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-AttachVolumeTestJSON-878348621-project May 13 17:35:01.096801 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: > May 13 17:35:01.096801 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Instance 9a72fdd8-ca24-4ae1-b007-7e22f411ad48 could not be found. May 13 17:35:01.096801 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '9a72fdd8-ca24-4ae1-b007-7e22f411ad48'} May 13 17:35:01.101630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:35:01.101630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:35:01.101630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:35:01.101630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:35:01.101630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:35:01.101630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:35:01.101630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:35:01.101630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:35:01.101630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:35:01.101630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:35:01.101630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a72fdd8-ca24-4ae1-b007-7e22f411ad48 could not be found. May 13 17:35:01.101630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:35:01.101630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:35:01.101630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:35:01.101630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:35:01.101630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:35:01.101630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:35:01.101630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:35:01.101630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:35:01.101630 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:35:01.103706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:35:01.103706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:35:01.103706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:35:01.103706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:35:01.103706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:35:01.103706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:35:01.103706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:35:01.103706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a72fdd8-ca24-4ae1-b007-7e22f411ad48 could not be found. May 13 17:35:01.103706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:35:01.103706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:35:01.103706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:35:01.103706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:35:01.103706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:35:01.103706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:35:01.103706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:35:01.103706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:35:01.103706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a72fdd8-ca24-4ae1-b007-7e22f411ad48 could not be found. May 13 17:35:01.103706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:35:01.105073 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4f47b58d-c9fc-42b4-a9aa-823b28f8458d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Returning 404 to user: Instance 9a72fdd8-ca24-4ae1-b007-7e22f411ad48 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:35:01.105073 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4f47b58d-c9fc-42b4-a9aa-823b28f8458d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 404 len: 111 microversion: 2.1 time: 0.032362 May 13 17:35:01.105073 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 576/1141] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:01 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:35:01.110803 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1bbf318c-60da-4755-a6a7-7293524ae3b4 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '.version_select at 0x7fa084c4a670>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:01.174976 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-1bbf318c-60da-4755-a6a7-7293524ae3b4 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1645480836" status: 202 len: 0 microversion: 2.1 time: 0.070356 May 13 17:35:01.175845 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 566/1142] 10.222.0.64 () {58 vars in 1220 bytes} [Fri May 13 17:35:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1645480836 => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:35:01.201120 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8ae080aa-208b-422c-87b0-958b495abe4e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:01.202550 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8ae080aa-208b-422c-87b0-958b495abe4e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:01.212053 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8ae080aa-208b-422c-87b0-958b495abe4e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:01.213357 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8ae080aa-208b-422c-87b0-958b495abe4e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:01.214326 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8ae080aa-208b-422c-87b0-958b495abe4e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:01.214988 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8ae080aa-208b-422c-87b0-958b495abe4e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:01.472637 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8ae080aa-208b-422c-87b0-958b495abe4e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:01.486894 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8ae080aa-208b-422c-87b0-958b495abe4e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1574 microversion: 2.1 time: 0.293054 May 13 17:35:01.490535 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 577/1143] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:01 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1574 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:35:02.160426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-e6472fcf-0823-4b34-9dc3-e8b9a6898401 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Action: 'create', calling method: .version_select at 0x7fa084c2bc10>, body: {"keypair": {"name": "tempest-keypair-142637754", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP6v1uHi2XSIASV6U90RBDKCmqqO6ZGxqmFsTjnFfa5WVEcuvIvJH/cO5/5F0iGSoYBkiUuHYwgU5YuFmmVrY74/XIgwbv+SC9eca2vGTshKqbI970ndkMnLDC0z2QjcEw=="}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:35:02.184075 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-e6472fcf-0823-4b34-9dc3-e8b9a6898401 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Getting quotas for project f8e7b818f3a74fc48f0faeeb3398069a. Resources: {'key_pairs'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:35:02.191831 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-e6472fcf-0823-4b34-9dc3-e8b9a6898401 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Getting quotas for user efc23cbdbebc423baed1a2cb6c6cd7e7 and project f8e7b818f3a74fc48f0faeeb3398069a. Resources: {'key_pairs'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:35:02.288536 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-e6472fcf-0823-4b34-9dc3-e8b9a6898401 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.133444 May 13 17:35:02.289601 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 567/1144] 10.222.0.64 () {60 vars in 1158 bytes} [Fri May 13 17:35:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:35:02.505929 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-04570a86-9646-43f1-a171-b4ae6c03769d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:02.506548 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-04570a86-9646-43f1-a171-b4ae6c03769d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:02.513704 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-04570a86-9646-43f1-a171-b4ae6c03769d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:02.514154 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-04570a86-9646-43f1-a171-b4ae6c03769d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:02.514938 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-04570a86-9646-43f1-a171-b4ae6c03769d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:02.515460 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-04570a86-9646-43f1-a171-b4ae6c03769d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:02.775052 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-04570a86-9646-43f1-a171-b4ae6c03769d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:02.796340 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-04570a86-9646-43f1-a171-b4ae6c03769d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1574 microversion: 2.1 time: 0.294265 May 13 17:35:02.799627 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 578/1145] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:02 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1574 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:03.818357 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-33d96ec3-6be9-4e26-8fd2-a2ef3a4c07c7 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:03.819176 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-33d96ec3-6be9-4e26-8fd2-a2ef3a4c07c7 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:03.849353 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-33d96ec3-6be9-4e26-8fd2-a2ef3a4c07c7 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:03.851865 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-33d96ec3-6be9-4e26-8fd2-a2ef3a4c07c7 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:03.860162 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-33d96ec3-6be9-4e26-8fd2-a2ef3a4c07c7 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:03.861389 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-33d96ec3-6be9-4e26-8fd2-a2ef3a4c07c7 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:04.125768 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-33d96ec3-6be9-4e26-8fd2-a2ef3a4c07c7 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:04.137386 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-33d96ec3-6be9-4e26-8fd2-a2ef3a4c07c7 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1561 microversion: 2.1 time: 0.324086 May 13 17:35:04.138984 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 568/1146] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:03 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1561 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:04.860498 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b843bfde-55cb-4a60-ba11-7d2a1a3dcd5a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1756490877", "imageRef": "7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "975cbf16-d3c5-4b6b-98f2-e842c863e717"}], "security_groups": [{"name": "tempest-securitygroup--212140257"}], "key_name": "tempest-keypair-142637754", "user_data": "}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:35:04.972244 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.network.neutron [None req-b843bfde-55cb-4a60-ba11-7d2a1a3dcd5a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] validate_networks() for [('975cbf16-d3c5-4b6b-98f2-e842c863e717', None, None, None, None, None)] {{(pid=117493) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 17:35:05.374191 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-b843bfde-55cb-4a60-ba11-7d2a1a3dcd5a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Flavor limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 17:35:05.374624 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-b843bfde-55cb-4a60-ba11-7d2a1a3dcd5a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Image limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 17:35:05.375106 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-b843bfde-55cb-4a60-ba11-7d2a1a3dcd5a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Flavor pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 17:35:05.375932 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-b843bfde-55cb-4a60-ba11-7d2a1a3dcd5a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Image pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 17:35:05.376907 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-b843bfde-55cb-4a60-ba11-7d2a1a3dcd5a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 17:35:05.385993 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b843bfde-55cb-4a60-ba11-7d2a1a3dcd5a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:05.386368 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b843bfde-55cb-4a60-ba11-7d2a1a3dcd5a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:05.387233 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b843bfde-55cb-4a60-ba11-7d2a1a3dcd5a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:05.387679 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b843bfde-55cb-4a60-ba11-7d2a1a3dcd5a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:05.404259 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-b843bfde-55cb-4a60-ba11-7d2a1a3dcd5a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Getting quotas for project f8e7b818f3a74fc48f0faeeb3398069a. Resources: {'ram', 'instances', 'cores'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:35:05.408241 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-b843bfde-55cb-4a60-ba11-7d2a1a3dcd5a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Getting quotas for user efc23cbdbebc423baed1a2cb6c6cd7e7 and project f8e7b818f3a74fc48f0faeeb3398069a. Resources: {'ram', 'instances', 'cores'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:35:05.419858 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b843bfde-55cb-4a60-ba11-7d2a1a3dcd5a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Going to run 1 instances... {{(pid=117493) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 17:35:05.422445 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b843bfde-55cb-4a60-ba11-7d2a1a3dcd5a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 17:35:05.492866 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 17:35:05.492866 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Fri May 13 17:35:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 17:35:05.547627 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b843bfde-55cb-4a60-ba11-7d2a1a3dcd5a tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.691129 May 13 17:35:05.548285 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 579/1147] 10.222.0.64 () {60 vars in 1146 bytes} [Fri May 13 17:35:04 2022] POST /compute/v2.1/servers => generated 401 bytes in 693 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 17:35:05.559344 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d0c4078d-f39c-4d97-a096-f7faea349657 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:05.559962 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d0c4078d-f39c-4d97-a096-f7faea349657 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:05.614762 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d0c4078d-f39c-4d97-a096-f7faea349657 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:05.623662 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d0c4078d-f39c-4d97-a096-f7faea349657 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e" status: 200 len: 1237 microversion: 2.1 time: 0.068282 May 13 17:35:05.624478 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 569/1148] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:05 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:35:06.641614 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9c6ccc50-7f19-4536-817e-ae9490274cc0 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:06.642222 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9c6ccc50-7f19-4536-817e-ae9490274cc0 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:06.650887 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9c6ccc50-7f19-4536-817e-ae9490274cc0 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:06.651372 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9c6ccc50-7f19-4536-817e-ae9490274cc0 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:06.652160 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9c6ccc50-7f19-4536-817e-ae9490274cc0 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:06.652601 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9c6ccc50-7f19-4536-817e-ae9490274cc0 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:06.721695 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9c6ccc50-7f19-4536-817e-ae9490274cc0 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:06.732251 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9c6ccc50-7f19-4536-817e-ae9490274cc0 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e" status: 200 len: 1241 microversion: 2.1 time: 0.094646 May 13 17:35:06.735169 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 580/1149] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:06 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:07.749485 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-86bd9138-a2a0-4194-a037-21339c3e4438 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:07.750648 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-86bd9138-a2a0-4194-a037-21339c3e4438 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:07.777935 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-86bd9138-a2a0-4194-a037-21339c3e4438 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:07.782767 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-86bd9138-a2a0-4194-a037-21339c3e4438 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:07.786141 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-86bd9138-a2a0-4194-a037-21339c3e4438 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:07.786604 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-86bd9138-a2a0-4194-a037-21339c3e4438 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:07.920414 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-86bd9138-a2a0-4194-a037-21339c3e4438 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:07.927974 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-86bd9138-a2a0-4194-a037-21339c3e4438 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e" status: 200 len: 1297 microversion: 2.1 time: 0.182598 May 13 17:35:07.928560 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 570/1150] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:07 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e => generated 1297 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:08.950707 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-502416cf-b3cf-4265-80fb-831d25eeae52 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:08.951460 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-502416cf-b3cf-4265-80fb-831d25eeae52 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:08.959812 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-502416cf-b3cf-4265-80fb-831d25eeae52 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:08.962178 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-502416cf-b3cf-4265-80fb-831d25eeae52 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:08.963534 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-502416cf-b3cf-4265-80fb-831d25eeae52 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:08.964742 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-502416cf-b3cf-4265-80fb-831d25eeae52 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:09.087527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-502416cf-b3cf-4265-80fb-831d25eeae52 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:09.097267 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-502416cf-b3cf-4265-80fb-831d25eeae52 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e" status: 200 len: 1295 microversion: 2.1 time: 0.151188 May 13 17:35:09.098572 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 581/1151] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:08 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e => generated 1295 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:10.116333 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7ef4d3f9-f66b-4d93-9bf9-6dc0122dcf6c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:10.117008 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7ef4d3f9-f66b-4d93-9bf9-6dc0122dcf6c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:10.127043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7ef4d3f9-f66b-4d93-9bf9-6dc0122dcf6c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:10.127538 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7ef4d3f9-f66b-4d93-9bf9-6dc0122dcf6c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:10.128341 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7ef4d3f9-f66b-4d93-9bf9-6dc0122dcf6c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:10.128779 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7ef4d3f9-f66b-4d93-9bf9-6dc0122dcf6c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:10.299751 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7ef4d3f9-f66b-4d93-9bf9-6dc0122dcf6c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:10.312110 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7ef4d3f9-f66b-4d93-9bf9-6dc0122dcf6c tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e" status: 200 len: 1362 microversion: 2.1 time: 0.199243 May 13 17:35:10.322342 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 571/1152] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:10 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:10.943771 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-05cc64ec-8a5a-467b-841d-558a5d700e60 req-755e19bd-03a0-469d-9342-78e0c3826bab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aade165c-bc0d-4b1d-9d9e-2f7aced9a29e", "tag": "ef8c1db6-43b0-4b4c-87b2-f41b6f47d816"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:35:10.953544 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-05cc64ec-8a5a-467b-841d-558a5d700e60 req-755e19bd-03a0-469d-9342-78e0c3826bab service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:10.954550 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-05cc64ec-8a5a-467b-841d-558a5d700e60 req-755e19bd-03a0-469d-9342-78e0c3826bab service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:10.990664 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-05cc64ec-8a5a-467b-841d-558a5d700e60 req-755e19bd-03a0-469d-9342-78e0c3826bab service nova] Creating event network-changed:ef8c1db6-43b0-4b4c-87b2-f41b6f47d816 for instance aade165c-bc0d-4b1d-9d9e-2f7aced9a29e on hv-cinder-84178 May 13 17:35:11.002713 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-05cc64ec-8a5a-467b-841d-558a5d700e60 req-755e19bd-03a0-469d-9342-78e0c3826bab service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067789 May 13 17:35:11.004038 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 582/1153] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:35:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:35:11.328301 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-32e98a37-8f99-4235-8b70-dcec51288a6d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:11.328984 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-32e98a37-8f99-4235-8b70-dcec51288a6d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:11.336203 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-32e98a37-8f99-4235-8b70-dcec51288a6d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:11.336921 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-32e98a37-8f99-4235-8b70-dcec51288a6d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:11.338400 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-32e98a37-8f99-4235-8b70-dcec51288a6d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:11.338929 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-32e98a37-8f99-4235-8b70-dcec51288a6d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:11.481272 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-32e98a37-8f99-4235-8b70-dcec51288a6d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:11.489000 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-32e98a37-8f99-4235-8b70-dcec51288a6d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e" status: 200 len: 1362 microversion: 2.1 time: 0.164634 May 13 17:35:11.498871 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 572/1154] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:11 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e => generated 1362 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:12.506910 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c6678f78-58d2-4fa8-9248-660af818798e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:12.507662 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c6678f78-58d2-4fa8-9248-660af818798e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:12.515256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c6678f78-58d2-4fa8-9248-660af818798e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:12.515781 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c6678f78-58d2-4fa8-9248-660af818798e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:12.516632 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c6678f78-58d2-4fa8-9248-660af818798e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:12.517250 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c6678f78-58d2-4fa8-9248-660af818798e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:12.714305 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c6678f78-58d2-4fa8-9248-660af818798e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:12.728208 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c6678f78-58d2-4fa8-9248-660af818798e tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e" status: 200 len: 1362 microversion: 2.1 time: 0.225980 May 13 17:35:12.728960 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 583/1155] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:12 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e => generated 1362 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:13.101652 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-dc171250-c20b-4776-923d-dcccc61e26be tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Action: 'create', calling method: .version_select at 0x7fa0849428b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1402304854", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJ0Qbf48Exn0nDCkMN2le/15xe4oD3WVoBeG2+ReVer1Feuj2Lk5TXR4eOrlXZtPWzC8+yYo/Mt7SisDmruEueu3FwQ7dibwUGHWvqJBABpYZN60E+wdiSY/k8J0krrVw=="}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:35:13.115513 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-dc171250-c20b-4776-923d-dcccc61e26be tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Getting quotas for project 60fd06693c624da5aa61222dfbde5b25. Resources: {'key_pairs'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:35:13.119797 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-dc171250-c20b-4776-923d-dcccc61e26be tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Getting quotas for user 45482c562be6438ebd456ee9512ef3e8 and project 60fd06693c624da5aa61222dfbde5b25. Resources: {'key_pairs'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:35:13.196751 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-dc171250-c20b-4776-923d-dcccc61e26be tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.256036 May 13 17:35:13.197577 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 573/1156] 10.222.0.64 () {60 vars in 1158 bytes} [Fri May 13 17:35:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:35:13.745751 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a115d9f4-2409-4298-bd3f-1033c78f4a67 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:13.746970 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a115d9f4-2409-4298-bd3f-1033c78f4a67 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:13.756694 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a115d9f4-2409-4298-bd3f-1033c78f4a67 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:13.757295 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a115d9f4-2409-4298-bd3f-1033c78f4a67 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:13.758391 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a115d9f4-2409-4298-bd3f-1033c78f4a67 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:13.758926 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a115d9f4-2409-4298-bd3f-1033c78f4a67 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:13.919053 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a115d9f4-2409-4298-bd3f-1033c78f4a67 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:13.921319 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a115d9f4-2409-4298-bd3f-1033c78f4a67 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e" status: 200 len: 1362 microversion: 2.1 time: 0.180015 May 13 17:35:13.921878 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 584/1157] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:13 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e => generated 1362 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:14.938981 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-eb129bb9-8649-4fdd-a163-a971f16462d8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:14.939649 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-eb129bb9-8649-4fdd-a163-a971f16462d8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:14.946371 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-eb129bb9-8649-4fdd-a163-a971f16462d8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:14.946822 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-eb129bb9-8649-4fdd-a163-a971f16462d8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:14.948213 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-eb129bb9-8649-4fdd-a163-a971f16462d8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:14.948838 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-eb129bb9-8649-4fdd-a163-a971f16462d8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:15.085039 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-eb129bb9-8649-4fdd-a163-a971f16462d8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:15.092701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-eb129bb9-8649-4fdd-a163-a971f16462d8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e" status: 200 len: 1362 microversion: 2.1 time: 0.158171 May 13 17:35:15.093386 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 574/1158] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:14 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e => generated 1362 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:16.109788 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-42cccb91-14fb-4e0b-8dca-fccb7ada5aad tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:16.111164 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-42cccb91-14fb-4e0b-8dca-fccb7ada5aad tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:16.117995 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-42cccb91-14fb-4e0b-8dca-fccb7ada5aad tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:16.118695 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-42cccb91-14fb-4e0b-8dca-fccb7ada5aad tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:16.120859 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-42cccb91-14fb-4e0b-8dca-fccb7ada5aad tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:16.121485 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-42cccb91-14fb-4e0b-8dca-fccb7ada5aad tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:16.268823 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-42cccb91-14fb-4e0b-8dca-fccb7ada5aad tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:16.276472 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-42cccb91-14fb-4e0b-8dca-fccb7ada5aad tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e" status: 200 len: 1362 microversion: 2.1 time: 0.170497 May 13 17:35:16.277259 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 585/1159] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:16 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e => generated 1362 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:17.293210 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a6d6d333-67ca-421a-93ea-f0e5ad3d22e9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:17.293996 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a6d6d333-67ca-421a-93ea-f0e5ad3d22e9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:17.300744 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a6d6d333-67ca-421a-93ea-f0e5ad3d22e9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:17.301202 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a6d6d333-67ca-421a-93ea-f0e5ad3d22e9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:17.302028 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a6d6d333-67ca-421a-93ea-f0e5ad3d22e9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:17.302470 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a6d6d333-67ca-421a-93ea-f0e5ad3d22e9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:17.438408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a6d6d333-67ca-421a-93ea-f0e5ad3d22e9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:17.445788 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a6d6d333-67ca-421a-93ea-f0e5ad3d22e9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e" status: 200 len: 1362 microversion: 2.1 time: 0.156826 May 13 17:35:17.446362 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 575/1160] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:17 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:18.325308 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-40a8ded7-8867-42b9-aeac-df2abe4e5729 req-ff78df0a-b00e-4b4a-bf6c-faf0e76c5b3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aade165c-bc0d-4b1d-9d9e-2f7aced9a29e", "name": "network-vif-plugged", "status": "completed", "tag": "ef8c1db6-43b0-4b4c-87b2-f41b6f47d816"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:35:18.333597 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-40a8ded7-8867-42b9-aeac-df2abe4e5729 req-ff78df0a-b00e-4b4a-bf6c-faf0e76c5b3e service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:18.334033 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-40a8ded7-8867-42b9-aeac-df2abe4e5729 req-ff78df0a-b00e-4b4a-bf6c-faf0e76c5b3e service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:18.345090 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-40a8ded7-8867-42b9-aeac-df2abe4e5729 req-ff78df0a-b00e-4b4a-bf6c-faf0e76c5b3e service nova] Creating event network-vif-plugged:ef8c1db6-43b0-4b4c-87b2-f41b6f47d816 for instance aade165c-bc0d-4b1d-9d9e-2f7aced9a29e on hv-cinder-84178 May 13 17:35:18.350406 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-40a8ded7-8867-42b9-aeac-df2abe4e5729 req-ff78df0a-b00e-4b4a-bf6c-faf0e76c5b3e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028721 May 13 17:35:18.350941 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 586/1161] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:35:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:35:18.462025 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d475b3a9-9f36-4f7a-9a8a-9b3de80de205 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:18.462820 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d475b3a9-9f36-4f7a-9a8a-9b3de80de205 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:18.471043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d475b3a9-9f36-4f7a-9a8a-9b3de80de205 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:18.471653 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d475b3a9-9f36-4f7a-9a8a-9b3de80de205 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:18.472698 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d475b3a9-9f36-4f7a-9a8a-9b3de80de205 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:18.473673 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d475b3a9-9f36-4f7a-9a8a-9b3de80de205 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:18.610155 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d475b3a9-9f36-4f7a-9a8a-9b3de80de205 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:18.617670 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d475b3a9-9f36-4f7a-9a8a-9b3de80de205 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e" status: 200 len: 1362 microversion: 2.1 time: 0.159461 May 13 17:35:18.618231 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 576/1162] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:18 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:19.635035 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5b14f444-943c-4c46-8abb-69a812f6e169 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:19.635784 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5b14f444-943c-4c46-8abb-69a812f6e169 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:19.642402 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5b14f444-943c-4c46-8abb-69a812f6e169 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:19.642873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5b14f444-943c-4c46-8abb-69a812f6e169 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:19.643687 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5b14f444-943c-4c46-8abb-69a812f6e169 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:19.644127 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5b14f444-943c-4c46-8abb-69a812f6e169 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:19.773001 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5b14f444-943c-4c46-8abb-69a812f6e169 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:19.783477 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5b14f444-943c-4c46-8abb-69a812f6e169 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e" status: 200 len: 1362 microversion: 2.1 time: 0.152987 May 13 17:35:19.784077 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 587/1163] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:19 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:20.800889 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-908d4cbb-6467-4c4c-b43b-cd731b6b7a86 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:20.801434 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-908d4cbb-6467-4c4c-b43b-cd731b6b7a86 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:20.808302 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-908d4cbb-6467-4c4c-b43b-cd731b6b7a86 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:20.808788 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-908d4cbb-6467-4c4c-b43b-cd731b6b7a86 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:20.809559 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-908d4cbb-6467-4c4c-b43b-cd731b6b7a86 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:20.810003 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-908d4cbb-6467-4c4c-b43b-cd731b6b7a86 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:20.937377 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-908d4cbb-6467-4c4c-b43b-cd731b6b7a86 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:20.944727 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-908d4cbb-6467-4c4c-b43b-cd731b6b7a86 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e" status: 200 len: 1548 microversion: 2.1 time: 0.147936 May 13 17:35:20.945300 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 577/1164] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:20 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:20.962296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5a48268b-ad15-4d0a-8398-3da17dc7d336 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:20.962884 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5a48268b-ad15-4d0a-8398-3da17dc7d336 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:20.969469 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5a48268b-ad15-4d0a-8398-3da17dc7d336 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:20.969922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5a48268b-ad15-4d0a-8398-3da17dc7d336 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:20.970706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5a48268b-ad15-4d0a-8398-3da17dc7d336 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:20.971166 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5a48268b-ad15-4d0a-8398-3da17dc7d336 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:21.047608 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5a48268b-ad15-4d0a-8398-3da17dc7d336 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089803 May 13 17:35:21.048212 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 588/1165] 10.222.0.64 () {58 vars in 1274 bytes} [Fri May 13 17:35:20 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:35:22.315260 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-1f2ce6d3-3447-4b39-9fea-41999a3f6138 req-a80e4882-cf06-401a-981d-efc126361cf8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aade165c-bc0d-4b1d-9d9e-2f7aced9a29e", "tag": "ef8c1db6-43b0-4b4c-87b2-f41b6f47d816"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:35:22.324230 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-1f2ce6d3-3447-4b39-9fea-41999a3f6138 req-a80e4882-cf06-401a-981d-efc126361cf8 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:22.324679 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-1f2ce6d3-3447-4b39-9fea-41999a3f6138 req-a80e4882-cf06-401a-981d-efc126361cf8 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:22.335851 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-1f2ce6d3-3447-4b39-9fea-41999a3f6138 req-a80e4882-cf06-401a-981d-efc126361cf8 service nova] Creating event network-changed:ef8c1db6-43b0-4b4c-87b2-f41b6f47d816 for instance aade165c-bc0d-4b1d-9d9e-2f7aced9a29e on hv-cinder-84178 May 13 17:35:22.341505 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-1f2ce6d3-3447-4b39-9fea-41999a3f6138 req-a80e4882-cf06-401a-981d-efc126361cf8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029948 May 13 17:35:22.342181 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 578/1166] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:35:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:35:36.419617 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c0ffafa4-3685-48f3-ab2e-c84138217301 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:36.420137 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c0ffafa4-3685-48f3-ab2e-c84138217301 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:36.425910 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c0ffafa4-3685-48f3-ab2e-c84138217301 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:36.426350 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c0ffafa4-3685-48f3-ab2e-c84138217301 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:36.427100 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c0ffafa4-3685-48f3-ab2e-c84138217301 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:36.427550 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c0ffafa4-3685-48f3-ab2e-c84138217301 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:36.504372 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-c0ffafa4-3685-48f3-ab2e-c84138217301 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lazy-loading 'services' on Instance uuid afe4a882-7b2b-4cfb-99f2-b722277d132c {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:35:36.674908 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c0ffafa4-3685-48f3-ab2e-c84138217301 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "DELETE /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c/os-volume_attachments/b0813a71-55ba-47b5-8c92-6c61750d0459" status: 202 len: 0 microversion: 2.1 time: 0.260357 May 13 17:35:36.675548 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 589/1167] 10.222.0.64 () {58 vars in 1415 bytes} [Fri May 13 17:35:36 2022] DELETE /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c/os-volume_attachments/b0813a71-55ba-47b5-8c92-6c61750d0459 => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:35:36.685706 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-2ed31df3-f4c8-4b2e-b9e2-8bccb24425d9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:36.686700 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-2ed31df3-f4c8-4b2e-b9e2-8bccb24425d9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:36.692871 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2ed31df3-f4c8-4b2e-b9e2-8bccb24425d9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:36.693319 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2ed31df3-f4c8-4b2e-b9e2-8bccb24425d9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:36.694093 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2ed31df3-f4c8-4b2e-b9e2-8bccb24425d9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:36.694529 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2ed31df3-f4c8-4b2e-b9e2-8bccb24425d9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:36.723776 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-2ed31df3-f4c8-4b2e-b9e2-8bccb24425d9 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043576 May 13 17:35:36.724330 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 579/1168] 10.222.0.64 () {58 vars in 1301 bytes} [Fri May 13 17:35:36 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:35:37.738019 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9bdae04f-d1de-4124-9126-df0e600741b7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:37.739016 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9bdae04f-d1de-4124-9126-df0e600741b7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:37.745430 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9bdae04f-d1de-4124-9126-df0e600741b7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:37.745888 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9bdae04f-d1de-4124-9126-df0e600741b7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:37.747295 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9bdae04f-d1de-4124-9126-df0e600741b7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:37.747738 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9bdae04f-d1de-4124-9126-df0e600741b7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:37.782011 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9bdae04f-d1de-4124-9126-df0e600741b7 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048629 May 13 17:35:37.782849 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 590/1169] 10.222.0.64 () {58 vars in 1301 bytes} [Fri May 13 17:35:37 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:35:38.795503 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b87eea51-6cc7-48b0-9363-548faede5372 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:38.796342 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b87eea51-6cc7-48b0-9363-548faede5372 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:38.802693 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b87eea51-6cc7-48b0-9363-548faede5372 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:38.803166 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b87eea51-6cc7-48b0-9363-548faede5372 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:38.803941 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b87eea51-6cc7-48b0-9363-548faede5372 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:38.804382 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b87eea51-6cc7-48b0-9363-548faede5372 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:38.832478 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b87eea51-6cc7-48b0-9363-548faede5372 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041106 May 13 17:35:38.833027 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 580/1170] 10.222.0.64 () {58 vars in 1301 bytes} [Fri May 13 17:35:38 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 17:35:38.904016 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fec087c1-35b9-470c-8805-fe4c039febaa tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:38.908792 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fec087c1-35b9-470c-8805-fe4c039febaa tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:38.910577 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fec087c1-35b9-470c-8805-fe4c039febaa tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:38.911029 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fec087c1-35b9-470c-8805-fe4c039febaa tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:38.911821 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fec087c1-35b9-470c-8805-fe4c039febaa tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:38.912260 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fec087c1-35b9-470c-8805-fe4c039febaa tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:38.936467 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fec087c1-35b9-470c-8805-fe4c039febaa tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Going to try to terminate instance {{(pid=117493) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 17:35:39.172560 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fec087c1-35b9-470c-8805-fe4c039febaa tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "DELETE /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 204 len: 0 microversion: 2.1 time: 0.272768 May 13 17:35:39.173155 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 591/1171] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:35:38 2022] DELETE /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 17:35:39.181191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-30d30e93-410b-4df9-8ae8-9b9e9bde87db tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:39.181800 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-30d30e93-410b-4df9-8ae8-9b9e9bde87db tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:39.188376 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-30d30e93-410b-4df9-8ae8-9b9e9bde87db tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:39.188825 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-30d30e93-410b-4df9-8ae8-9b9e9bde87db tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:39.189591 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-30d30e93-410b-4df9-8ae8-9b9e9bde87db tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:39.190027 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-30d30e93-410b-4df9-8ae8-9b9e9bde87db tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:39.319647 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-30d30e93-410b-4df9-8ae8-9b9e9bde87db tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:39.327537 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-30d30e93-410b-4df9-8ae8-9b9e9bde87db tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1691 microversion: 2.1 time: 0.150172 May 13 17:35:39.328103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 581/1172] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:39 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1691 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:40.345520 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-996acbe4-89ed-49ec-b5a7-e0df59621214 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:40.346208 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-996acbe4-89ed-49ec-b5a7-e0df59621214 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:40.352727 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-996acbe4-89ed-49ec-b5a7-e0df59621214 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:40.354877 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-996acbe4-89ed-49ec-b5a7-e0df59621214 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:40.354877 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-996acbe4-89ed-49ec-b5a7-e0df59621214 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:40.354877 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-996acbe4-89ed-49ec-b5a7-e0df59621214 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:40.483433 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-996acbe4-89ed-49ec-b5a7-e0df59621214 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:40.492729 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-996acbe4-89ed-49ec-b5a7-e0df59621214 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1691 microversion: 2.1 time: 0.151481 May 13 17:35:40.493305 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 592/1173] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:40 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:40.622920 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b14ae9f2-f56b-415a-870a-6f917324302c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1697767566", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1402304854", "security_groups": [{"name": "tempest-secgroup-smoke-2107664403"}], "block_device_mapping_v2": [{"uuid": "ac79cb24-8dbf-4769-b9c1-81bf91ab54a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9bc3da8d-37aa-4c42-a26a-ff8ce273072b"}]}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:35:40.732057 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.network.neutron [None req-b14ae9f2-f56b-415a-870a-6f917324302c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] validate_networks() for [('9bc3da8d-37aa-4c42-a26a-ff8ce273072b', None, None, None, None, None)] {{(pid=117492) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 17:35:41.082983 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-b14ae9f2-f56b-415a-870a-6f917324302c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Flavor limits 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 17:35:41.083442 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-b14ae9f2-f56b-415a-870a-6f917324302c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Image limits 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 17:35:41.083913 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-b14ae9f2-f56b-415a-870a-6f917324302c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Flavor pref 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 17:35:41.084319 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-b14ae9f2-f56b-415a-870a-6f917324302c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Image pref 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 17:35:41.084729 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-b14ae9f2-f56b-415a-870a-6f917324302c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 17:35:41.093878 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b14ae9f2-f56b-415a-870a-6f917324302c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:41.094321 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b14ae9f2-f56b-415a-870a-6f917324302c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:41.095110 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b14ae9f2-f56b-415a-870a-6f917324302c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:41.095569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b14ae9f2-f56b-415a-870a-6f917324302c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:41.111888 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-b14ae9f2-f56b-415a-870a-6f917324302c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Getting quotas for project 60fd06693c624da5aa61222dfbde5b25. Resources: {'ram', 'instances', 'cores'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:35:41.115708 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-b14ae9f2-f56b-415a-870a-6f917324302c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Getting quotas for user 45482c562be6438ebd456ee9512ef3e8 and project 60fd06693c624da5aa61222dfbde5b25. Resources: {'ram', 'instances', 'cores'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:35:41.170665 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b14ae9f2-f56b-415a-870a-6f917324302c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Going to run 1 instances... {{(pid=117492) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 17:35:41.172754 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b14ae9f2-f56b-415a-870a-6f917324302c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ac79cb24-8dbf-4769-b9c1-81bf91ab54a5',volume_size=None,volume_type=None)] {{(pid=117492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 17:35:41.485239 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b14ae9f2-f56b-415a-870a-6f917324302c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.864872 May 13 17:35:41.487426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 582/1174] 10.222.0.64 () {60 vars in 1146 bytes} [Fri May 13 17:35:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 869 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 17:35:41.498713 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-327e753b-5e2d-4861-839a-b99dfd51611e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:41.499338 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-327e753b-5e2d-4861-839a-b99dfd51611e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:41.514464 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-4262aca3-8c48-495d-8378-b6a64a4c7354 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:41.515057 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-4262aca3-8c48-495d-8378-b6a64a4c7354 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:41.521292 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4262aca3-8c48-495d-8378-b6a64a4c7354 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:41.521759 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4262aca3-8c48-495d-8378-b6a64a4c7354 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:41.522534 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4262aca3-8c48-495d-8378-b6a64a4c7354 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:41.522976 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4262aca3-8c48-495d-8378-b6a64a4c7354 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:41.557552 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-327e753b-5e2d-4861-839a-b99dfd51611e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:41.565204 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-327e753b-5e2d-4861-839a-b99dfd51611e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 200 len: 1095 microversion: 2.1 time: 0.070628 May 13 17:35:41.571176 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 593/1175] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:41 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 1095 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:41.660038 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-4262aca3-8c48-495d-8378-b6a64a4c7354 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:41.667526 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-4262aca3-8c48-495d-8378-b6a64a4c7354 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1691 microversion: 2.1 time: 0.157338 May 13 17:35:41.668102 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 583/1176] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:41 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1691 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:35:42.581628 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-48e5b2e0-1c9b-4eb9-a368-57c60dcabd50 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:42.582218 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-48e5b2e0-1c9b-4eb9-a368-57c60dcabd50 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:42.589069 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-48e5b2e0-1c9b-4eb9-a368-57c60dcabd50 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:42.589512 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-48e5b2e0-1c9b-4eb9-a368-57c60dcabd50 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:42.590270 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-48e5b2e0-1c9b-4eb9-a368-57c60dcabd50 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:42.590792 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-48e5b2e0-1c9b-4eb9-a368-57c60dcabd50 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:42.649588 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-48e5b2e0-1c9b-4eb9-a368-57c60dcabd50 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:42.656770 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-48e5b2e0-1c9b-4eb9-a368-57c60dcabd50 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 200 len: 1145 microversion: 2.1 time: 0.078956 May 13 17:35:42.657338 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 594/1177] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:42 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 1145 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:42.683808 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-e05c1092-55d7-41b1-b90a-bbc0a29d2f4b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:42.684952 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-e05c1092-55d7-41b1-b90a-bbc0a29d2f4b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:42.691337 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e05c1092-55d7-41b1-b90a-bbc0a29d2f4b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:42.691791 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e05c1092-55d7-41b1-b90a-bbc0a29d2f4b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:42.692567 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e05c1092-55d7-41b1-b90a-bbc0a29d2f4b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:42.693004 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e05c1092-55d7-41b1-b90a-bbc0a29d2f4b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:42.803196 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f773bb66-282d-4805-a14f-0b4b5a12ec7e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:42.803727 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f773bb66-282d-4805-a14f-0b4b5a12ec7e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:42.809505 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f773bb66-282d-4805-a14f-0b4b5a12ec7e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:42.809964 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f773bb66-282d-4805-a14f-0b4b5a12ec7e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:42.810744 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f773bb66-282d-4805-a14f-0b4b5a12ec7e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:42.811225 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f773bb66-282d-4805-a14f-0b4b5a12ec7e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:42.821381 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-e05c1092-55d7-41b1-b90a-bbc0a29d2f4b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:42.829166 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-e05c1092-55d7-41b1-b90a-bbc0a29d2f4b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1691 microversion: 2.1 time: 0.149189 May 13 17:35:42.830030 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 584/1178] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:42 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1691 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:42.834723 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f773bb66-282d-4805-a14f-0b4b5a12ec7e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e/ips" status: 200 len: 151 microversion: 2.1 time: 0.035348 May 13 17:35:42.835465 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 595/1179] 10.222.0.64 () {58 vars in 1247 bytes} [Fri May 13 17:35:42 2022] GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:35:43.673584 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-cb1f15d6-8d46-4f1e-bdda-3724aff8f34c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:43.674187 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-cb1f15d6-8d46-4f1e-bdda-3724aff8f34c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:43.680112 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cb1f15d6-8d46-4f1e-bdda-3724aff8f34c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:43.680559 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cb1f15d6-8d46-4f1e-bdda-3724aff8f34c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:43.681325 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cb1f15d6-8d46-4f1e-bdda-3724aff8f34c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:43.681760 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cb1f15d6-8d46-4f1e-bdda-3724aff8f34c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:43.744528 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-cb1f15d6-8d46-4f1e-bdda-3724aff8f34c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:43.752524 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-cb1f15d6-8d46-4f1e-bdda-3724aff8f34c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 200 len: 1193 microversion: 2.1 time: 0.082826 May 13 17:35:43.753315 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 585/1180] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:43 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 1193 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:43.849806 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-0d804aad-6d22-45a8-916e-d7a69ae83eb2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:43.850649 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-0d804aad-6d22-45a8-916e-d7a69ae83eb2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:43.858169 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0d804aad-6d22-45a8-916e-d7a69ae83eb2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:43.858627 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0d804aad-6d22-45a8-916e-d7a69ae83eb2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:43.859451 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0d804aad-6d22-45a8-916e-d7a69ae83eb2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:43.859896 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-0d804aad-6d22-45a8-916e-d7a69ae83eb2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:44.384508 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-0d804aad-6d22-45a8-916e-d7a69ae83eb2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:44.393290 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-0d804aad-6d22-45a8-916e-d7a69ae83eb2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1691 microversion: 2.1 time: 0.547318 May 13 17:35:44.393976 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 596/1181] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:43 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1691 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:35:44.676134 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-c81bcf0e-8f25-4c11-94bd-4b606ced715d req-ca7a27db-3f42-4784-a979-4267ade4e7cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "afe4a882-7b2b-4cfb-99f2-b722277d132c", "name": "network-vif-deleted", "tag": "d05de053-6bc4-4262-992c-723e87e69ddf"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:35:44.686130 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-c81bcf0e-8f25-4c11-94bd-4b606ced715d req-ca7a27db-3f42-4784-a979-4267ade4e7cd service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:44.686580 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-c81bcf0e-8f25-4c11-94bd-4b606ced715d req-ca7a27db-3f42-4784-a979-4267ade4e7cd service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:44.701371 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-c81bcf0e-8f25-4c11-94bd-4b606ced715d req-ca7a27db-3f42-4784-a979-4267ade4e7cd service nova] Creating event network-vif-deleted:d05de053-6bc4-4262-992c-723e87e69ddf for instance afe4a882-7b2b-4cfb-99f2-b722277d132c on hv-cinder-84178 May 13 17:35:44.716572 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-c81bcf0e-8f25-4c11-94bd-4b606ced715d req-ca7a27db-3f42-4784-a979-4267ade4e7cd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043438 May 13 17:35:44.720380 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 586/1182] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:35:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:35:44.769644 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9b62c2cd-2990-447c-b106-fa3ac9ce2c9c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:44.772296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9b62c2cd-2990-447c-b106-fa3ac9ce2c9c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:44.776139 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9b62c2cd-2990-447c-b106-fa3ac9ce2c9c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:44.776582 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9b62c2cd-2990-447c-b106-fa3ac9ce2c9c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:44.777356 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9b62c2cd-2990-447c-b106-fa3ac9ce2c9c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:44.777794 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9b62c2cd-2990-447c-b106-fa3ac9ce2c9c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:44.839869 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9b62c2cd-2990-447c-b106-fa3ac9ce2c9c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:44.848226 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9b62c2cd-2990-447c-b106-fa3ac9ce2c9c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 200 len: 1211 microversion: 2.1 time: 0.082412 May 13 17:35:44.848798 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 597/1183] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:44 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 1211 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:45.418414 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-5d99f86e-7504-443f-9c46-66d3b2e2eca5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "138b16aa-10e7-45d8-9e00-f9817a6463a4"}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:35:45.419893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b82e5769-a26c-4b5d-9f7f-1253c9a354e4 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:45.420310 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-5d99f86e-7504-443f-9c46-66d3b2e2eca5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:45.420647 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b82e5769-a26c-4b5d-9f7f-1253c9a354e4 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:45.426332 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5d99f86e-7504-443f-9c46-66d3b2e2eca5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:45.426843 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5d99f86e-7504-443f-9c46-66d3b2e2eca5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:45.427395 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b82e5769-a26c-4b5d-9f7f-1253c9a354e4 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:45.427670 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5d99f86e-7504-443f-9c46-66d3b2e2eca5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:45.428081 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b82e5769-a26c-4b5d-9f7f-1253c9a354e4 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:45.428211 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5d99f86e-7504-443f-9c46-66d3b2e2eca5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:45.429038 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b82e5769-a26c-4b5d-9f7f-1253c9a354e4 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:45.429584 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b82e5769-a26c-4b5d-9f7f-1253c9a354e4 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:45.472189 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b82e5769-a26c-4b5d-9f7f-1253c9a354e4 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:45.472189 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b82e5769-a26c-4b5d-9f7f-1253c9a354e4 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:45.472189 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-b82e5769-a26c-4b5d-9f7f-1253c9a354e4 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lazy-loading 'fault' on Instance uuid afe4a882-7b2b-4cfb-99f2-b722277d132c {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:35:45.529260 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b82e5769-a26c-4b5d-9f7f-1253c9a354e4 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:45.538774 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b82e5769-a26c-4b5d-9f7f-1253c9a354e4 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 200 len: 1336 microversion: 2.1 time: 0.123398 May 13 17:35:45.540519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 598/1184] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:45 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 1336 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:35:45.868735 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-04f01fc6-de38-4d21-9ef2-a30611200b04 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:45.869906 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-04f01fc6-de38-4d21-9ef2-a30611200b04 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:45.881135 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-04f01fc6-de38-4d21-9ef2-a30611200b04 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:45.881135 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-04f01fc6-de38-4d21-9ef2-a30611200b04 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:45.881135 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-04f01fc6-de38-4d21-9ef2-a30611200b04 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:45.881135 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-04f01fc6-de38-4d21-9ef2-a30611200b04 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:46.133114 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-04f01fc6-de38-4d21-9ef2-a30611200b04 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:46.141502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-04f01fc6-de38-4d21-9ef2-a30611200b04 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 200 len: 1279 microversion: 2.1 time: 0.276850 May 13 17:35:46.142080 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 599/1185] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:45 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 1279 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:46.457244 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-5d99f86e-7504-443f-9c46-66d3b2e2eca5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "POST /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.045170 May 13 17:35:46.457866 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 587/1186] 10.222.0.64 () {60 vars in 1322 bytes} [Fri May 13 17:35:45 2022] POST /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e/os-volume_attachments => generated 194 bytes in 1047 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:35:46.559156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fc0bedaa-2c8a-415d-99d8-70549319b083 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:46.560537 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fc0bedaa-2c8a-415d-99d8-70549319b083 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: afe4a882-7b2b-4cfb-99f2-b722277d132c] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:46.568015 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fc0bedaa-2c8a-415d-99d8-70549319b083 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:46.569069 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fc0bedaa-2c8a-415d-99d8-70549319b083 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:46.577686 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fc0bedaa-2c8a-415d-99d8-70549319b083 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:46.578439 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fc0bedaa-2c8a-415d-99d8-70549319b083 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:46.610120 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-fc0bedaa-2c8a-415d-99d8-70549319b083 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] HTTP exception thrown: Instance afe4a882-7b2b-4cfb-99f2-b722277d132c could not be found. May 13 17:35:46.611950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fc0bedaa-2c8a-415d-99d8-70549319b083 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Request method failure captured: May 13 17:35:46.611950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c HTTP/1.1 May 13 17:35:46.611950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:35:46.611950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:35:46.611950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:35:46.611950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:35:46.611950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:35:46.611950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:35:46.611950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:35:46.611950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:35:46.611950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpVDPQ2EZlknyXEVYSbq1zYoA7qgi4TwOnKp1PCBXIVh9BXUHZ-NHURPOT1kGG7ilrBqfjIrle9-DF8hvEreUoI2Wl7a2ReyAgBImyd5i31N1LSELowfKgHaob5uflDcPzm1aA4ceGxUsDXZlHEatd8eQnnzECiIdnl5V_fwiM8ou84 May 13 17:35:46.611950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:35:46.611950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:35:46.611950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:35:46.611950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:35:46.611950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:35:46.611950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:35:46.611950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 27832590c00f47b7b09c343e892f310a May 13 17:35:46.611950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1094369910 May 13 17:35:46.611950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:35:46.611950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:35:46.613425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/27832590c00f47b7b09c343e892f310a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/27832590c00f47b7b09c343e892f310a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_27832590c00f47b7b09c343e892f310a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/27832590c00f47b7b09c343e892f310a"}]}] May 13 17:35:46.613425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1094369910 May 13 17:35:46.613425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 27832590c00f47b7b09c343e892f310a May 13 17:35:46.613425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1094369910 May 13 17:35:46.613425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-ServerRescueNegativeTestJSON-1094369910-project May 13 17:35:46.613425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:35:46.613425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:35:46.613425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: a0294c57ba3f41bc8cf2cac294bb678c May 13 17:35:46.613425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1094369910-project May 13 17:35:46.613425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: > May 13 17:35:46.613425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Instance afe4a882-7b2b-4cfb-99f2-b722277d132c could not be found. May 13 17:35:46.613425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'id': 'afe4a882-7b2b-4cfb-99f2-b722277d132c'} May 13 17:35:46.614296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:35:46.614296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:35:46.614296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:35:46.614296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:35:46.614296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:35:46.614296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:35:46.614296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:35:46.614296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:35:46.614296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:35:46.614296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:35:46.614296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance afe4a882-7b2b-4cfb-99f2-b722277d132c could not be found. May 13 17:35:46.614296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:35:46.614296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:35:46.614296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:35:46.614296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:35:46.614296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:35:46.614296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:35:46.614296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:35:46.614296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:35:46.614296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:35:46.616535 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:35:46.616535 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:35:46.616535 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:35:46.616535 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:35:46.616535 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:35:46.616535 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:35:46.616535 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:35:46.616535 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance afe4a882-7b2b-4cfb-99f2-b722277d132c could not be found. May 13 17:35:46.616535 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:35:46.616535 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:35:46.616535 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:35:46.616535 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:35:46.616535 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:35:46.616535 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:35:46.616535 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:35:46.616535 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:35:46.616535 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance afe4a882-7b2b-4cfb-99f2-b722277d132c could not be found. May 13 17:35:46.616535 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:35:46.619307 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fc0bedaa-2c8a-415d-99d8-70549319b083 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Returning 404 to user: Instance afe4a882-7b2b-4cfb-99f2-b722277d132c could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:35:46.619307 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fc0bedaa-2c8a-415d-99d8-70549319b083 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c" status: 404 len: 111 microversion: 2.1 time: 0.060062 May 13 17:35:46.619307 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 600/1187] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:46 2022] GET /compute/v2.1/servers/afe4a882-7b2b-4cfb-99f2-b722277d132c => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:35:46.626245 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-298117ba-a94a-4741-9412-bd5a9b14041b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '.version_select at 0x7fa0849bd160>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:46.706069 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-298117ba-a94a-4741-9412-bd5a9b14041b tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1476670057" status: 202 len: 0 microversion: 2.1 time: 0.084446 May 13 17:35:46.707011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 588/1188] 10.222.0.64 () {58 vars in 1220 bytes} [Fri May 13 17:35:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1476670057 => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:35:46.734259 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-1460617a-aec7-45be-a4d2-42e661d4da14 req-3758c51e-088c-4825-a273-c3952b90c78e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28943379-c589-47c4-939d-c9c2b0e67b7f", "tag": "ec51b328-6c86-4e0d-9a2e-180d591317ab"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:35:46.753537 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-1460617a-aec7-45be-a4d2-42e661d4da14 req-3758c51e-088c-4825-a273-c3952b90c78e service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:46.754141 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-1460617a-aec7-45be-a4d2-42e661d4da14 req-3758c51e-088c-4825-a273-c3952b90c78e service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:46.775878 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-1460617a-aec7-45be-a4d2-42e661d4da14 req-3758c51e-088c-4825-a273-c3952b90c78e service nova] Creating event network-changed:ec51b328-6c86-4e0d-9a2e-180d591317ab for instance 28943379-c589-47c4-939d-c9c2b0e67b7f on hv-cinder-84178 May 13 17:35:46.776406 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-1460617a-aec7-45be-a4d2-42e661d4da14 req-3758c51e-088c-4825-a273-c3952b90c78e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045670 May 13 17:35:46.777465 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 601/1189] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:35:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:35:47.158119 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-41ea0476-d4e5-4c3e-8c40-54eb1e518f62 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:47.158740 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-41ea0476-d4e5-4c3e-8c40-54eb1e518f62 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:47.166147 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-41ea0476-d4e5-4c3e-8c40-54eb1e518f62 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:47.166597 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-41ea0476-d4e5-4c3e-8c40-54eb1e518f62 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:47.167404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-41ea0476-d4e5-4c3e-8c40-54eb1e518f62 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:47.168028 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-41ea0476-d4e5-4c3e-8c40-54eb1e518f62 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:47.365467 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-41ea0476-d4e5-4c3e-8c40-54eb1e518f62 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:47.374202 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-41ea0476-d4e5-4c3e-8c40-54eb1e518f62 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 200 len: 1267 microversion: 2.1 time: 0.220164 May 13 17:35:47.377035 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 589/1190] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:47 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 1267 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:48.392296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-edb03001-2c7a-46fb-9951-ef6722f8c09e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:48.392988 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-edb03001-2c7a-46fb-9951-ef6722f8c09e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:48.399479 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-edb03001-2c7a-46fb-9951-ef6722f8c09e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:48.399923 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-edb03001-2c7a-46fb-9951-ef6722f8c09e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:48.400674 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-edb03001-2c7a-46fb-9951-ef6722f8c09e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:48.401105 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-edb03001-2c7a-46fb-9951-ef6722f8c09e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:48.530072 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-edb03001-2c7a-46fb-9951-ef6722f8c09e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:48.537411 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-edb03001-2c7a-46fb-9951-ef6722f8c09e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 200 len: 1267 microversion: 2.1 time: 0.149329 May 13 17:35:48.538774 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 602/1191] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:48 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:49.553840 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-31a153fd-c648-405d-b772-0582c9f7a637 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:49.554609 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-31a153fd-c648-405d-b772-0582c9f7a637 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:49.561294 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-31a153fd-c648-405d-b772-0582c9f7a637 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:49.561740 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-31a153fd-c648-405d-b772-0582c9f7a637 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:49.562545 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-31a153fd-c648-405d-b772-0582c9f7a637 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:49.562982 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-31a153fd-c648-405d-b772-0582c9f7a637 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:49.705590 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-31a153fd-c648-405d-b772-0582c9f7a637 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:49.712942 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-31a153fd-c648-405d-b772-0582c9f7a637 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 200 len: 1267 microversion: 2.1 time: 0.162997 May 13 17:35:49.713521 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 590/1192] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:49 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:50.136652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c5f52424-303b-4a10-bc6a-d6b1ea1c64ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:50.137831 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c5f52424-303b-4a10-bc6a-d6b1ea1c64ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:50.144036 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c5f52424-303b-4a10-bc6a-d6b1ea1c64ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:50.144483 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c5f52424-303b-4a10-bc6a-d6b1ea1c64ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:50.145545 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c5f52424-303b-4a10-bc6a-d6b1ea1c64ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:50.145978 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c5f52424-303b-4a10-bc6a-d6b1ea1c64ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:50.173839 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c5f52424-303b-4a10-bc6a-d6b1ea1c64ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Going to try to terminate instance {{(pid=117493) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 17:35:50.390434 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c5f52424-303b-4a10-bc6a-d6b1ea1c64ab tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 204 len: 0 microversion: 2.1 time: 0.260174 May 13 17:35:50.391091 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 603/1193] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:35:50 2022] DELETE /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 17:35:50.399439 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7a906013-a95d-4634-9ebe-fe04945a0915 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:50.400043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7a906013-a95d-4634-9ebe-fe04945a0915 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:50.405959 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7a906013-a95d-4634-9ebe-fe04945a0915 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:50.406401 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7a906013-a95d-4634-9ebe-fe04945a0915 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:50.407205 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7a906013-a95d-4634-9ebe-fe04945a0915 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:50.407658 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7a906013-a95d-4634-9ebe-fe04945a0915 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:50.535360 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7a906013-a95d-4634-9ebe-fe04945a0915 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:50.544116 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7a906013-a95d-4634-9ebe-fe04945a0915 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1508 microversion: 2.1 time: 0.147832 May 13 17:35:50.544700 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 591/1194] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:50 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:50.730754 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6ce9d2ba-06a3-4c4d-a1b5-0bc7b21b84f5 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:50.731915 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6ce9d2ba-06a3-4c4d-a1b5-0bc7b21b84f5 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:50.737837 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6ce9d2ba-06a3-4c4d-a1b5-0bc7b21b84f5 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:50.738298 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6ce9d2ba-06a3-4c4d-a1b5-0bc7b21b84f5 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:50.739069 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6ce9d2ba-06a3-4c4d-a1b5-0bc7b21b84f5 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:50.739540 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6ce9d2ba-06a3-4c4d-a1b5-0bc7b21b84f5 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:50.869962 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6ce9d2ba-06a3-4c4d-a1b5-0bc7b21b84f5 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:50.877759 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6ce9d2ba-06a3-4c4d-a1b5-0bc7b21b84f5 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 200 len: 1267 microversion: 2.1 time: 0.151594 May 13 17:35:50.878320 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 604/1195] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:50 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:51.561171 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-2c68f757-1baf-4f9c-bf7a-5a148241c223 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:51.561777 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-2c68f757-1baf-4f9c-bf7a-5a148241c223 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:51.568811 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2c68f757-1baf-4f9c-bf7a-5a148241c223 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:51.569261 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2c68f757-1baf-4f9c-bf7a-5a148241c223 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:51.570090 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2c68f757-1baf-4f9c-bf7a-5a148241c223 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:51.570472 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2c68f757-1baf-4f9c-bf7a-5a148241c223 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:51.701044 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-2c68f757-1baf-4f9c-bf7a-5a148241c223 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:51.708434 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-2c68f757-1baf-4f9c-bf7a-5a148241c223 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1508 microversion: 2.1 time: 0.151156 May 13 17:35:51.709036 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 592/1196] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:51 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:51.817303 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-c6e4fd20-f7d2-4838-bf7e-c732b68b2496 req-74833f4e-4fc5-4e0e-818d-d5ec7c726da9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9d3d26f-4dd5-4068-bee2-60b3d1a71055", "name": "network-vif-deleted", "tag": "c3ddca4e-2887-4fd8-919d-7abc574f54f5"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:35:51.826345 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-c6e4fd20-f7d2-4838-bf7e-c732b68b2496 req-74833f4e-4fc5-4e0e-818d-d5ec7c726da9 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:51.827253 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-c6e4fd20-f7d2-4838-bf7e-c732b68b2496 req-74833f4e-4fc5-4e0e-818d-d5ec7c726da9 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:51.838194 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-c6e4fd20-f7d2-4838-bf7e-c732b68b2496 req-74833f4e-4fc5-4e0e-818d-d5ec7c726da9 service nova] Creating event network-vif-deleted:c3ddca4e-2887-4fd8-919d-7abc574f54f5 for instance f9d3d26f-4dd5-4068-bee2-60b3d1a71055 on hv-cinder-84178 May 13 17:35:51.843558 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-c6e4fd20-f7d2-4838-bf7e-c732b68b2496 req-74833f4e-4fc5-4e0e-818d-d5ec7c726da9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030057 May 13 17:35:51.845780 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 605/1197] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:35:51.894788 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-8a923b1a-2a16-440e-95a4-19bd9b047d05 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:51.895529 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-8a923b1a-2a16-440e-95a4-19bd9b047d05 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:51.905608 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8a923b1a-2a16-440e-95a4-19bd9b047d05 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:51.906258 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8a923b1a-2a16-440e-95a4-19bd9b047d05 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:51.907063 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8a923b1a-2a16-440e-95a4-19bd9b047d05 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:51.907541 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8a923b1a-2a16-440e-95a4-19bd9b047d05 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:52.047270 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-8a923b1a-2a16-440e-95a4-19bd9b047d05 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:52.054705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-8a923b1a-2a16-440e-95a4-19bd9b047d05 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 200 len: 1267 microversion: 2.1 time: 0.163992 May 13 17:35:52.055367 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 593/1198] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:51 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 1267 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:52.725740 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8c07d86f-475a-42ed-9b81-213697eda888 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:52.726454 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8c07d86f-475a-42ed-9b81-213697eda888 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:52.733670 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8c07d86f-475a-42ed-9b81-213697eda888 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:52.734124 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8c07d86f-475a-42ed-9b81-213697eda888 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:52.734929 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8c07d86f-475a-42ed-9b81-213697eda888 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:52.735394 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8c07d86f-475a-42ed-9b81-213697eda888 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:52.768122 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8c07d86f-475a-42ed-9b81-213697eda888 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:52.768495 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8c07d86f-475a-42ed-9b81-213697eda888 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:52.768946 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-8c07d86f-475a-42ed-9b81-213697eda888 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lazy-loading 'fault' on Instance uuid f9d3d26f-4dd5-4068-bee2-60b3d1a71055 {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:35:52.811169 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8c07d86f-475a-42ed-9b81-213697eda888 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:52.818562 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8c07d86f-475a-42ed-9b81-213697eda888 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 200 len: 1312 microversion: 2.1 time: 0.097002 May 13 17:35:52.819184 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 606/1199] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:52 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 1312 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:53.072199 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a4d0f6de-2413-41b7-a1f6-1bcf46b313f3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:53.072766 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a4d0f6de-2413-41b7-a1f6-1bcf46b313f3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:53.079642 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a4d0f6de-2413-41b7-a1f6-1bcf46b313f3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:53.080095 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a4d0f6de-2413-41b7-a1f6-1bcf46b313f3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:53.080861 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a4d0f6de-2413-41b7-a1f6-1bcf46b313f3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:53.081300 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a4d0f6de-2413-41b7-a1f6-1bcf46b313f3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:53.207856 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a4d0f6de-2413-41b7-a1f6-1bcf46b313f3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:53.219866 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a4d0f6de-2413-41b7-a1f6-1bcf46b313f3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 200 len: 1267 microversion: 2.1 time: 0.151483 May 13 17:35:53.220466 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 594/1200] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:53 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:53.836105 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e9e9f88d-b9ac-461f-b459-16e89263056e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:53.836709 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e9e9f88d-b9ac-461f-b459-16e89263056e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: f9d3d26f-4dd5-4068-bee2-60b3d1a71055] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:53.843095 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e9e9f88d-b9ac-461f-b459-16e89263056e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:53.843573 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e9e9f88d-b9ac-461f-b459-16e89263056e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:53.844333 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e9e9f88d-b9ac-461f-b459-16e89263056e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:53.844766 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e9e9f88d-b9ac-461f-b459-16e89263056e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:53.859106 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-e9e9f88d-b9ac-461f-b459-16e89263056e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] HTTP exception thrown: Instance f9d3d26f-4dd5-4068-bee2-60b3d1a71055 could not be found. May 13 17:35:53.860809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e9e9f88d-b9ac-461f-b459-16e89263056e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Request method failure captured: May 13 17:35:53.860809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 HTTP/1.1 May 13 17:35:53.860809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:35:53.860809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:35:53.860809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:35:53.860809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:35:53.860809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:35:53.860809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:35:53.860809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:35:53.860809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:35:53.860809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpVDPQ2EZlknyXEVYSbq1zYoA7qgi4TwOnKp1PCBXIVh9BXUHZ-NHURPOT1kGG7ilrBqfjIrle9-DF8hvEreUoI2Wl7a2ReyAgBImyd5i31N1LSELowfKgHaob5uflDcPzm1aA4ceGxUsDXZlHEatd8eQnnzECiIdnl5V_fwiM8ou84 May 13 17:35:53.860809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:35:53.860809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:35:53.860809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:35:53.860809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:35:53.860809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:35:53.860809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:35:53.860809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 27832590c00f47b7b09c343e892f310a May 13 17:35:53.860809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1094369910 May 13 17:35:53.860809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:35:53.860809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:35:53.862409 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/27832590c00f47b7b09c343e892f310a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/27832590c00f47b7b09c343e892f310a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_27832590c00f47b7b09c343e892f310a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/27832590c00f47b7b09c343e892f310a"}]}] May 13 17:35:53.862409 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1094369910 May 13 17:35:53.862409 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 27832590c00f47b7b09c343e892f310a May 13 17:35:53.862409 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1094369910 May 13 17:35:53.862409 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-ServerRescueNegativeTestJSON-1094369910-project May 13 17:35:53.862409 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:35:53.862409 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:35:53.862409 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: a0294c57ba3f41bc8cf2cac294bb678c May 13 17:35:53.862409 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1094369910-project May 13 17:35:53.862409 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: > May 13 17:35:53.862409 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Instance f9d3d26f-4dd5-4068-bee2-60b3d1a71055 could not be found. May 13 17:35:53.862409 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'id': 'f9d3d26f-4dd5-4068-bee2-60b3d1a71055'} May 13 17:35:53.865502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:35:53.865502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:35:53.865502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:35:53.865502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:35:53.865502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:35:53.865502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:35:53.865502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:35:53.865502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:35:53.865502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:35:53.865502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:35:53.865502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9d3d26f-4dd5-4068-bee2-60b3d1a71055 could not be found. May 13 17:35:53.865502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:35:53.865502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:35:53.865502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:35:53.865502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:35:53.865502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:35:53.865502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:35:53.865502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:35:53.865502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:35:53.865502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:35:53.867011 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:35:53.867011 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:35:53.867011 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:35:53.867011 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:35:53.867011 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:35:53.867011 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:35:53.867011 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:35:53.867011 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9d3d26f-4dd5-4068-bee2-60b3d1a71055 could not be found. May 13 17:35:53.867011 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:35:53.867011 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:35:53.867011 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:35:53.867011 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:35:53.867011 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:35:53.867011 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:35:53.867011 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:35:53.867011 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:35:53.867011 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9d3d26f-4dd5-4068-bee2-60b3d1a71055 could not be found. May 13 17:35:53.867011 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:35:53.868419 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e9e9f88d-b9ac-461f-b459-16e89263056e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Returning 404 to user: Instance f9d3d26f-4dd5-4068-bee2-60b3d1a71055 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:35:53.868419 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e9e9f88d-b9ac-461f-b459-16e89263056e tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055" status: 404 len: 111 microversion: 2.1 time: 0.030040 May 13 17:35:53.868419 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 607/1201] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:53 2022] GET /compute/v2.1/servers/f9d3d26f-4dd5-4068-bee2-60b3d1a71055 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:35:53.871434 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a2392ece-aa90-418d-b016-47302e8795cf tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:53.872600 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a2392ece-aa90-418d-b016-47302e8795cf tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:53.879632 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a2392ece-aa90-418d-b016-47302e8795cf tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:53.880092 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a2392ece-aa90-418d-b016-47302e8795cf tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:53.880868 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a2392ece-aa90-418d-b016-47302e8795cf tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:53.881304 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a2392ece-aa90-418d-b016-47302e8795cf tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:53.905058 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a2392ece-aa90-418d-b016-47302e8795cf tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Going to try to terminate instance {{(pid=117492) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 17:35:54.217870 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a2392ece-aa90-418d-b016-47302e8795cf tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 204 len: 0 microversion: 2.1 time: 0.350345 May 13 17:35:54.218538 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 595/1202] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:35:53 2022] DELETE /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 17:35:54.226401 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2190038a-9409-407e-b9fd-d031ee7e4ed8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:54.227330 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2190038a-9409-407e-b9fd-d031ee7e4ed8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:54.233336 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2190038a-9409-407e-b9fd-d031ee7e4ed8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:54.233784 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2190038a-9409-407e-b9fd-d031ee7e4ed8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:54.234549 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2190038a-9409-407e-b9fd-d031ee7e4ed8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:54.234986 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2190038a-9409-407e-b9fd-d031ee7e4ed8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:54.237295 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-df17f210-975d-4dbf-8e74-108f930e8e37 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:54.238002 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-df17f210-975d-4dbf-8e74-108f930e8e37 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:54.244288 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-df17f210-975d-4dbf-8e74-108f930e8e37 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:54.244501 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-df17f210-975d-4dbf-8e74-108f930e8e37 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:54.245301 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-df17f210-975d-4dbf-8e74-108f930e8e37 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:54.246004 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-df17f210-975d-4dbf-8e74-108f930e8e37 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:54.373828 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2190038a-9409-407e-b9fd-d031ee7e4ed8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:54.379146 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-df17f210-975d-4dbf-8e74-108f930e8e37 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:54.381402 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2190038a-9409-407e-b9fd-d031ee7e4ed8 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.158819 May 13 17:35:54.382173 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 608/1203] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:54 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:54.386430 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-df17f210-975d-4dbf-8e74-108f930e8e37 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 200 len: 1267 microversion: 2.1 time: 0.153294 May 13 17:35:54.386991 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 596/1204] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:54 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:35:55.162720 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-00823a0e-6f47-4751-929b-7814c74d0ab3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "138b16aa-10e7-45d8-9e00-f9817a6463a4"}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:35:55.163887 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-00823a0e-6f47-4751-929b-7814c74d0ab3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:55.170138 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-00823a0e-6f47-4751-929b-7814c74d0ab3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:55.170592 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-00823a0e-6f47-4751-929b-7814c74d0ab3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:55.171391 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-00823a0e-6f47-4751-929b-7814c74d0ab3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:55.171828 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-00823a0e-6f47-4751-929b-7814c74d0ab3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:55.246724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-00823a0e-6f47-4751-929b-7814c74d0ab3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] HTTP exception thrown: Invalid volume: volume 138b16aa-10e7-45d8-9e00-f9817a6463a4 is already attached to instances: a8b767fd-1e8b-4b26-8c43-236c7698129e May 13 17:35:55.248519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-00823a0e-6f47-4751-929b-7814c74d0ab3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Request method failure captured: May 13 17:35:55.248519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: POST /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e/os-volume_attachments HTTP/1.1 May 13 17:35:55.248519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:35:55.248519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:35:55.248519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:35:55.248519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 74 May 13 17:35:55.248519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:35:55.248519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:35:55.248519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:35:55.248519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:35:55.248519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpTc_RrVmxy2iGzrfQJ2JGoLflGoXwQ8zHwIs9aTMpqZXeC78NlpwKZWhCbBdWoUAU_vvb08rrsxX0JsiGqFmgTgDrNVuDQuL1AnwToYH23sqxxCURxc3AiIzkc2Y-1ZSXLpS2OklBXtojTSGTsLp1Uq6KzyDltfns2DlgjWoGsxMc0 May 13 17:35:55.248519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:35:55.248519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:35:55.248519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:35:55.248519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:35:55.248519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:35:55.248519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:35:55.248519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: ae7b37b41d944427945d783a460ca12a May 13 17:35:55.248519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:35:55.248519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:35:55.248519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:35:55.250118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ae7b37b41d944427945d783a460ca12a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}] May 13 17:35:55.250118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-AttachVolumeNegativeTest-908235212 May 13 17:35:55.250118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: ae7b37b41d944427945d783a460ca12a May 13 17:35:55.250118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:35:55.250118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:35:55.250118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:35:55.250118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:35:55.250118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: dfc52b61bcf845d1953a5a111abb3666 May 13 17:35:55.250118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:35:55.250118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: May 13 17:35:55.250118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {"volumeAttachment": {"volumeId": "138b16aa-10e7-45d8-9e00-f9817a6463a4"}} May 13 17:35:55.250118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: > May 13 17:35:55.251114 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Invalid volume: volume 138b16aa-10e7-45d8-9e00-f9817a6463a4 is already attached to instances: a8b767fd-1e8b-4b26-8c43-236c7698129e May 13 17:35:55.251114 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'server_id': 'a8b767fd-1e8b-4b26-8c43-236c7698129e', 'body': {'volumeAttachment': {'volumeId': '138b16aa-10e7-45d8-9e00-f9817a6463a4'}}} May 13 17:35:55.251114 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:35:55.251114 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:35:55.251114 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 13 17:35:55.251114 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 13 17:35:55.251114 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 13 17:35:55.251114 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 13 17:35:55.251114 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 13 17:35:55.251114 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 13 17:35:55.251114 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 13 17:35:55.251114 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 13 17:35:55.251114 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 13 17:35:55.251114 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 13 17:35:55.251114 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 138b16aa-10e7-45d8-9e00-f9817a6463a4 is already attached to instances: a8b767fd-1e8b-4b26-8c43-236c7698129e May 13 17:35:55.251114 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:35:55.251114 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:35:55.251114 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:35:55.251114 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:35:55.252652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:35:55.252652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:35:55.252652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:35:55.252652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:35:55.252652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:35:55.252652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:35:55.252652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 17:35:55.252652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 17:35:55.252652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 17:35:55.252652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 17:35:55.252652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 13 17:35:55.252652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 13 17:35:55.252652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 13 17:35:55.252652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 13 17:35:55.252652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 138b16aa-10e7-45d8-9e00-f9817a6463a4 is already attached to instances: a8b767fd-1e8b-4b26-8c43-236c7698129e May 13 17:35:55.252652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:35:55.252652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:35:55.252652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:35:55.252652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:35:55.252652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:35:55.254265 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:35:55.254265 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:35:55.254265 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:35:55.254265 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 138b16aa-10e7-45d8-9e00-f9817a6463a4 is already attached to instances: a8b767fd-1e8b-4b26-8c43-236c7698129e May 13 17:35:55.254265 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:35:55.254265 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-00823a0e-6f47-4751-929b-7814c74d0ab3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Returning 400 to user: Invalid volume: volume 138b16aa-10e7-45d8-9e00-f9817a6463a4 is already attached to instances: a8b767fd-1e8b-4b26-8c43-236c7698129e {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:35:55.254265 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-00823a0e-6f47-4751-929b-7814c74d0ab3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "POST /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.091322 May 13 17:35:55.254265 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 609/1205] 10.222.0.64 () {60 vars in 1322 bytes} [Fri May 13 17:35:55 2022] POST /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e/os-volume_attachments => generated 174 bytes in 92 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 13 17:35:55.310007 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-9505dc20-3c05-4148-a6e7-070c3562db76 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:55.310494 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-9505dc20-3c05-4148-a6e7-070c3562db76 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:55.316725 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9505dc20-3c05-4148-a6e7-070c3562db76 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:55.317170 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9505dc20-3c05-4148-a6e7-070c3562db76 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:55.317927 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9505dc20-3c05-4148-a6e7-070c3562db76 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:55.318359 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9505dc20-3c05-4148-a6e7-070c3562db76 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:55.397596 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.objects.instance [None req-9505dc20-3c05-4148-a6e7-070c3562db76 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lazy-loading 'services' on Instance uuid a8b767fd-1e8b-4b26-8c43-236c7698129e {{(pid=117492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:35:55.397781 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b88d8a93-8976-4407-97f5-e5c6bc6e1293 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:55.398450 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b88d8a93-8976-4407-97f5-e5c6bc6e1293 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:55.405699 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b88d8a93-8976-4407-97f5-e5c6bc6e1293 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:55.406154 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b88d8a93-8976-4407-97f5-e5c6bc6e1293 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:55.406932 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b88d8a93-8976-4407-97f5-e5c6bc6e1293 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:55.407399 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b88d8a93-8976-4407-97f5-e5c6bc6e1293 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:55.537158 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b88d8a93-8976-4407-97f5-e5c6bc6e1293 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:55.545132 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b88d8a93-8976-4407-97f5-e5c6bc6e1293 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.151282 May 13 17:35:55.545695 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 610/1206] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:55 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:35:55.550176 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e61451df-3c0a-40f5-b430-9d6eb1257a5c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:55.550774 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e61451df-3c0a-40f5-b430-9d6eb1257a5c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:55.556277 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e61451df-3c0a-40f5-b430-9d6eb1257a5c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:55.556729 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e61451df-3c0a-40f5-b430-9d6eb1257a5c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:55.557494 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e61451df-3c0a-40f5-b430-9d6eb1257a5c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:55.557931 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e61451df-3c0a-40f5-b430-9d6eb1257a5c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:55.623566 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-9505dc20-3c05-4148-a6e7-070c3562db76 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e/os-volume_attachments/138b16aa-10e7-45d8-9e00-f9817a6463a4" status: 202 len: 0 microversion: 2.1 time: 0.315497 May 13 17:35:55.624417 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 597/1207] 10.222.0.64 () {58 vars in 1415 bytes} [Fri May 13 17:35:55 2022] DELETE /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e/os-volume_attachments/138b16aa-10e7-45d8-9e00-f9817a6463a4 => generated 0 bytes in 319 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:35:55.634815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-59da68e7-0082-4b6c-aa61-ae4c25021d04 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:55.635943 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-59da68e7-0082-4b6c-aa61-ae4c25021d04 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:55.643013 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-59da68e7-0082-4b6c-aa61-ae4c25021d04 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:55.643333 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-59da68e7-0082-4b6c-aa61-ae4c25021d04 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:55.644128 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-59da68e7-0082-4b6c-aa61-ae4c25021d04 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:55.644653 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-59da68e7-0082-4b6c-aa61-ae4c25021d04 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:55.675004 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-59da68e7-0082-4b6c-aa61-ae4c25021d04 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044437 May 13 17:35:55.675612 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 598/1208] 10.222.0.64 () {58 vars in 1301 bytes} [Fri May 13 17:35:55 2022] GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:35:55.697332 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e61451df-3c0a-40f5-b430-9d6eb1257a5c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:55.704816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e61451df-3c0a-40f5-b430-9d6eb1257a5c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 200 len: 1267 microversion: 2.1 time: 0.158182 May 13 17:35:55.705623 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 611/1209] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:55 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:56.563584 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b0a121b3-591b-43a2-8902-cfceafcd13c2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:56.564196 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b0a121b3-591b-43a2-8902-cfceafcd13c2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:56.570622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b0a121b3-591b-43a2-8902-cfceafcd13c2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:56.571077 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b0a121b3-591b-43a2-8902-cfceafcd13c2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:56.571879 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b0a121b3-591b-43a2-8902-cfceafcd13c2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:56.572347 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b0a121b3-591b-43a2-8902-cfceafcd13c2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:56.686672 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5075239c-f381-46f3-ad64-629a6031a8c1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:56.687698 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5075239c-f381-46f3-ad64-629a6031a8c1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:56.693977 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5075239c-f381-46f3-ad64-629a6031a8c1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:56.694434 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5075239c-f381-46f3-ad64-629a6031a8c1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:56.695237 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5075239c-f381-46f3-ad64-629a6031a8c1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:56.695673 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5075239c-f381-46f3-ad64-629a6031a8c1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:56.710210 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b0a121b3-591b-43a2-8902-cfceafcd13c2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:56.717792 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b0a121b3-591b-43a2-8902-cfceafcd13c2 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1520 microversion: 2.1 time: 0.158631 May 13 17:35:56.718584 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 599/1210] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:56 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:35:56.725762 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5075239c-f381-46f3-ad64-629a6031a8c1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043674 May 13 17:35:56.726469 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 612/1211] 10.222.0.64 () {58 vars in 1301 bytes} [Fri May 13 17:35:56 2022] GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:35:56.775496 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3b6e66d7-f9b8-4d2c-a398-4490cf922d21 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:56.776204 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3b6e66d7-f9b8-4d2c-a398-4490cf922d21 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:56.783544 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3b6e66d7-f9b8-4d2c-a398-4490cf922d21 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:56.784075 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3b6e66d7-f9b8-4d2c-a398-4490cf922d21 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:56.784921 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3b6e66d7-f9b8-4d2c-a398-4490cf922d21 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:56.785461 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3b6e66d7-f9b8-4d2c-a398-4490cf922d21 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:56.922744 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3b6e66d7-f9b8-4d2c-a398-4490cf922d21 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:56.930301 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3b6e66d7-f9b8-4d2c-a398-4490cf922d21 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 200 len: 1267 microversion: 2.1 time: 0.158745 May 13 17:35:56.930959 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 600/1212] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:56 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:57.245314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-b62c0338-44b3-4ef6-9bba-484fa180499b req-fac6bba2-b2ea-483d-b546-bf878c1ae4bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ee92d4ec-0b6a-4fae-8b6c-eaf330781f58", "name": "network-vif-deleted", "tag": "8c1697c5-1f14-4626-9fa8-129fec582059"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:35:57.255100 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-b62c0338-44b3-4ef6-9bba-484fa180499b req-fac6bba2-b2ea-483d-b546-bf878c1ae4bc service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:57.256478 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-b62c0338-44b3-4ef6-9bba-484fa180499b req-fac6bba2-b2ea-483d-b546-bf878c1ae4bc service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:57.267817 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-b62c0338-44b3-4ef6-9bba-484fa180499b req-fac6bba2-b2ea-483d-b546-bf878c1ae4bc service nova] Creating event network-vif-deleted:8c1697c5-1f14-4626-9fa8-129fec582059 for instance ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 on hv-cinder-84178 May 13 17:35:57.273078 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-b62c0338-44b3-4ef6-9bba-484fa180499b req-fac6bba2-b2ea-483d-b546-bf878c1ae4bc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032874 May 13 17:35:57.273749 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 613/1213] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:35:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:35:57.735050 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7ab5acc3-484c-4719-9303-5f379b4e8492 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:57.735687 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7ab5acc3-484c-4719-9303-5f379b4e8492 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:57.738328 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1f8cec28-4fe4-4e3c-8755-78bb64afc897 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:57.739391 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1f8cec28-4fe4-4e3c-8755-78bb64afc897 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:57.742185 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7ab5acc3-484c-4719-9303-5f379b4e8492 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:57.742698 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7ab5acc3-484c-4719-9303-5f379b4e8492 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:57.743496 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7ab5acc3-484c-4719-9303-5f379b4e8492 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:57.743932 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7ab5acc3-484c-4719-9303-5f379b4e8492 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:57.745249 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1f8cec28-4fe4-4e3c-8755-78bb64afc897 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:57.745697 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1f8cec28-4fe4-4e3c-8755-78bb64afc897 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:57.746452 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1f8cec28-4fe4-4e3c-8755-78bb64afc897 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:57.747411 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1f8cec28-4fe4-4e3c-8755-78bb64afc897 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:57.774997 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7ab5acc3-484c-4719-9303-5f379b4e8492 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:57.775353 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7ab5acc3-484c-4719-9303-5f379b4e8492 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:57.775466 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1f8cec28-4fe4-4e3c-8755-78bb64afc897 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041816 May 13 17:35:57.775795 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.objects.instance [None req-7ab5acc3-484c-4719-9303-5f379b4e8492 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lazy-loading 'fault' on Instance uuid ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 {{(pid=117492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:35:57.776000 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 614/1214] 10.222.0.64 () {58 vars in 1301 bytes} [Fri May 13 17:35:57 2022] GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 13 17:35:57.815974 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7ab5acc3-484c-4719-9303-5f379b4e8492 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:57.823830 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7ab5acc3-484c-4719-9303-5f379b4e8492 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1311 microversion: 2.1 time: 0.092857 May 13 17:35:57.824733 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 601/1215] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:57 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1311 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:57.835524 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d5d763ad-d71d-402b-a63f-4fcf09844603 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:57.836020 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d5d763ad-d71d-402b-a63f-4fcf09844603 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:57.841918 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d5d763ad-d71d-402b-a63f-4fcf09844603 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:57.842365 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d5d763ad-d71d-402b-a63f-4fcf09844603 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:57.843147 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d5d763ad-d71d-402b-a63f-4fcf09844603 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:57.843597 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d5d763ad-d71d-402b-a63f-4fcf09844603 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:57.867828 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d5d763ad-d71d-402b-a63f-4fcf09844603 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Going to try to terminate instance {{(pid=117493) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 17:35:57.947255 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6da0fa4f-83b6-4d63-ab7f-7e1e80fd354e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:57.947865 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6da0fa4f-83b6-4d63-ab7f-7e1e80fd354e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:57.954905 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6da0fa4f-83b6-4d63-ab7f-7e1e80fd354e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:57.955394 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6da0fa4f-83b6-4d63-ab7f-7e1e80fd354e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:57.956214 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6da0fa4f-83b6-4d63-ab7f-7e1e80fd354e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:57.956660 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6da0fa4f-83b6-4d63-ab7f-7e1e80fd354e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:58.089111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6da0fa4f-83b6-4d63-ab7f-7e1e80fd354e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:58.096471 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6da0fa4f-83b6-4d63-ab7f-7e1e80fd354e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 200 len: 1267 microversion: 2.1 time: 0.153119 May 13 17:35:58.097045 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 602/1216] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:57 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:35:58.143944 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d5d763ad-d71d-402b-a63f-4fcf09844603 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e" status: 204 len: 0 microversion: 2.1 time: 0.311862 May 13 17:35:58.144519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 615/1217] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:35:57 2022] DELETE /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 17:35:58.152575 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-e180239c-df09-4ce5-86fa-4ec06595f7b7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:58.153171 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-e180239c-df09-4ce5-86fa-4ec06595f7b7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:58.159095 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e180239c-df09-4ce5-86fa-4ec06595f7b7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:58.161352 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e180239c-df09-4ce5-86fa-4ec06595f7b7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:58.161352 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e180239c-df09-4ce5-86fa-4ec06595f7b7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:58.161352 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e180239c-df09-4ce5-86fa-4ec06595f7b7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:58.290034 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-e180239c-df09-4ce5-86fa-4ec06595f7b7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:58.297883 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-e180239c-df09-4ce5-86fa-4ec06595f7b7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e" status: 200 len: 1683 microversion: 2.1 time: 0.149072 May 13 17:35:58.298450 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 603/1218] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:58 2022] GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e => generated 1683 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:58.576590 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-4067e8de-46eb-4ee3-9e83-8d5b9e645a48 req-4c8533a3-c96a-4116-8bcc-3ab9d56c5a68 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28943379-c589-47c4-939d-c9c2b0e67b7f", "name": "network-vif-plugged", "status": "completed", "tag": "ec51b328-6c86-4e0d-9a2e-180d591317ab"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:35:58.584449 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-4067e8de-46eb-4ee3-9e83-8d5b9e645a48 req-4c8533a3-c96a-4116-8bcc-3ab9d56c5a68 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:58.584896 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-4067e8de-46eb-4ee3-9e83-8d5b9e645a48 req-4c8533a3-c96a-4116-8bcc-3ab9d56c5a68 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:58.596564 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-4067e8de-46eb-4ee3-9e83-8d5b9e645a48 req-4c8533a3-c96a-4116-8bcc-3ab9d56c5a68 service nova] Creating event network-vif-plugged:ec51b328-6c86-4e0d-9a2e-180d591317ab for instance 28943379-c589-47c4-939d-c9c2b0e67b7f on hv-cinder-84178 May 13 17:35:58.601213 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-4067e8de-46eb-4ee3-9e83-8d5b9e645a48 req-4c8533a3-c96a-4116-8bcc-3ab9d56c5a68 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028907 May 13 17:35:58.602083 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 616/1219] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:35:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:35:58.841221 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b0b0859a-dae3-4829-ac04-44f3402f9503 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:58.842333 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b0b0859a-dae3-4829-ac04-44f3402f9503 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:58.848654 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b0b0859a-dae3-4829-ac04-44f3402f9503 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:58.849114 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b0b0859a-dae3-4829-ac04-44f3402f9503 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:58.849886 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b0b0859a-dae3-4829-ac04-44f3402f9503 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:58.850327 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b0b0859a-dae3-4829-ac04-44f3402f9503 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:58.880312 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b0b0859a-dae3-4829-ac04-44f3402f9503 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:58.880796 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b0b0859a-dae3-4829-ac04-44f3402f9503 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:58.881242 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.objects.instance [None req-b0b0859a-dae3-4829-ac04-44f3402f9503 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lazy-loading 'fault' on Instance uuid ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 {{(pid=117492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:35:58.925073 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b0b0859a-dae3-4829-ac04-44f3402f9503 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0294c57ba3f41bc8cf2cac294bb678c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27832590c00f47b7b09c343e892f310a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:58.932643 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b0b0859a-dae3-4829-ac04-44f3402f9503 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 200 len: 1311 microversion: 2.1 time: 0.095441 May 13 17:35:58.933226 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 604/1220] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:58 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 1311 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:59.114511 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ea1e108a-88bf-439c-89d7-8a35f6662535 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:59.115259 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ea1e108a-88bf-439c-89d7-8a35f6662535 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:59.121346 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ea1e108a-88bf-439c-89d7-8a35f6662535 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:59.121799 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ea1e108a-88bf-439c-89d7-8a35f6662535 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:59.122571 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ea1e108a-88bf-439c-89d7-8a35f6662535 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:59.123012 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ea1e108a-88bf-439c-89d7-8a35f6662535 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:59.254610 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ea1e108a-88bf-439c-89d7-8a35f6662535 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:59.261861 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ea1e108a-88bf-439c-89d7-8a35f6662535 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 200 len: 1267 microversion: 2.1 time: 0.152112 May 13 17:35:59.262423 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 617/1221] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:59 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:59.314538 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-25608782-7f83-4f8f-b1b8-d7ffb96b575d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:59.315172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-25608782-7f83-4f8f-b1b8-d7ffb96b575d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:59.321072 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-25608782-7f83-4f8f-b1b8-d7ffb96b575d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:59.321524 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-25608782-7f83-4f8f-b1b8-d7ffb96b575d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:59.322287 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-25608782-7f83-4f8f-b1b8-d7ffb96b575d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:59.322752 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-25608782-7f83-4f8f-b1b8-d7ffb96b575d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:59.445695 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-25608782-7f83-4f8f-b1b8-d7ffb96b575d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:35:59.453622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-25608782-7f83-4f8f-b1b8-d7ffb96b575d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e" status: 200 len: 1683 microversion: 2.1 time: 0.143692 May 13 17:35:59.454196 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 605/1222] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:59 2022] GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e => generated 1683 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:35:59.949063 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1de62514-01a9-4a25-8882-e14a8ee40c05 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:35:59.949664 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1de62514-01a9-4a25-8882-e14a8ee40c05 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] [instance: ee92d4ec-0b6a-4fae-8b6c-eaf330781f58] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:35:59.955600 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1de62514-01a9-4a25-8882-e14a8ee40c05 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:59.956073 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1de62514-01a9-4a25-8882-e14a8ee40c05 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:59.956837 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1de62514-01a9-4a25-8882-e14a8ee40c05 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:35:59.957268 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1de62514-01a9-4a25-8882-e14a8ee40c05 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:35:59.970750 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-1de62514-01a9-4a25-8882-e14a8ee40c05 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] HTTP exception thrown: Instance ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 could not be found. May 13 17:35:59.972412 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1de62514-01a9-4a25-8882-e14a8ee40c05 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Request method failure captured: May 13 17:35:59.972412 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 HTTP/1.1 May 13 17:35:59.972412 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:35:59.972412 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:35:59.972412 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:35:59.972412 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:35:59.972412 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:35:59.972412 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:35:59.972412 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:35:59.972412 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:35:59.972412 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpVDPQ2EZlknyXEVYSbq1zYoA7qgi4TwOnKp1PCBXIVh9BXUHZ-NHURPOT1kGG7ilrBqfjIrle9-DF8hvEreUoI2Wl7a2ReyAgBImyd5i31N1LSELowfKgHaob5uflDcPzm1aA4ceGxUsDXZlHEatd8eQnnzECiIdnl5V_fwiM8ou84 May 13 17:35:59.972412 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:35:59.972412 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:35:59.972412 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:35:59.972412 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:35:59.972412 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:35:59.972412 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:35:59.972412 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 27832590c00f47b7b09c343e892f310a May 13 17:35:59.972412 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1094369910 May 13 17:35:59.972412 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:35:59.972412 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:35:59.973947 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/27832590c00f47b7b09c343e892f310a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/27832590c00f47b7b09c343e892f310a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_27832590c00f47b7b09c343e892f310a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/27832590c00f47b7b09c343e892f310a"}]}] May 13 17:35:59.973947 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1094369910 May 13 17:35:59.973947 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 27832590c00f47b7b09c343e892f310a May 13 17:35:59.973947 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1094369910 May 13 17:35:59.973947 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-ServerRescueNegativeTestJSON-1094369910-project May 13 17:35:59.973947 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:35:59.973947 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:35:59.973947 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: a0294c57ba3f41bc8cf2cac294bb678c May 13 17:35:59.973947 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1094369910-project May 13 17:35:59.973947 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: > May 13 17:35:59.973947 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Instance ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 could not be found. May 13 17:35:59.973947 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'id': 'ee92d4ec-0b6a-4fae-8b6c-eaf330781f58'} May 13 17:35:59.974857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:35:59.974857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:35:59.974857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:35:59.974857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:35:59.974857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:35:59.974857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:35:59.974857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:35:59.974857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:35:59.974857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:35:59.974857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:35:59.974857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 could not be found. May 13 17:35:59.974857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:35:59.974857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:35:59.974857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:35:59.974857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:35:59.974857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:35:59.974857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:35:59.974857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:35:59.974857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:35:59.974857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:35:59.976398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:35:59.976398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:35:59.976398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:35:59.976398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:35:59.976398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:35:59.976398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:35:59.976398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:35:59.976398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 could not be found. May 13 17:35:59.976398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:35:59.976398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:35:59.976398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:35:59.976398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:35:59.976398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:35:59.976398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:35:59.976398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:35:59.976398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:35:59.976398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 could not be found. May 13 17:35:59.976398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:35:59.977986 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1de62514-01a9-4a25-8882-e14a8ee40c05 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] Returning 404 to user: Instance ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:35:59.977986 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1de62514-01a9-4a25-8882-e14a8ee40c05 tempest-ServerRescueNegativeTestJSON-1094369910 tempest-ServerRescueNegativeTestJSON-1094369910-project] 10.222.0.64 "GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58" status: 404 len: 111 microversion: 2.1 time: 0.028550 May 13 17:35:59.977986 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 618/1223] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:35:59 2022] GET /compute/v2.1/servers/ee92d4ec-0b6a-4fae-8b6c-eaf330781f58 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:36:00.280140 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1d0fb4fa-3dec-4337-8621-acb7c7fb20bc tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:00.280750 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-1d0fb4fa-3dec-4337-8621-acb7c7fb20bc tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:00.287180 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1d0fb4fa-3dec-4337-8621-acb7c7fb20bc tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:00.287811 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1d0fb4fa-3dec-4337-8621-acb7c7fb20bc tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:00.288746 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1d0fb4fa-3dec-4337-8621-acb7c7fb20bc tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:00.289466 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1d0fb4fa-3dec-4337-8621-acb7c7fb20bc tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:00.472357 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-83d4f42d-7f23-4916-a321-ae6a143f86f7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:00.472967 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-83d4f42d-7f23-4916-a321-ae6a143f86f7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:00.481264 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-83d4f42d-7f23-4916-a321-ae6a143f86f7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:00.482003 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-83d4f42d-7f23-4916-a321-ae6a143f86f7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:00.483746 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-83d4f42d-7f23-4916-a321-ae6a143f86f7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:00.484381 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-83d4f42d-7f23-4916-a321-ae6a143f86f7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:00.519800 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-1d0fb4fa-3dec-4337-8621-acb7c7fb20bc tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:00.527787 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-1d0fb4fa-3dec-4337-8621-acb7c7fb20bc tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 200 len: 1267 microversion: 2.1 time: 0.252363 May 13 17:36:00.528422 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 606/1224] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:36:00 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 1267 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:36:00.734809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-83d4f42d-7f23-4916-a321-ae6a143f86f7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:00.743346 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-83d4f42d-7f23-4916-a321-ae6a143f86f7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e" status: 200 len: 1683 microversion: 2.1 time: 0.276550 May 13 17:36:00.753284 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 619/1225] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:36:00 2022] GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e => generated 1683 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:36:01.551748 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-d7217106-f72f-4718-a065-183965808923 req-9e4faf5d-7860-416f-a52b-2d665941683e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b767fd-1e8b-4b26-8c43-236c7698129e", "name": "network-vif-deleted", "tag": "c9743a5a-7193-4cc0-93e6-05a64a6339e1"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:36:01.556146 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-903863db-d3d0-4b54-bfe4-da4eefaa6656 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:01.556777 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-903863db-d3d0-4b54-bfe4-da4eefaa6656 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:01.564516 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-d7217106-f72f-4718-a065-183965808923 req-9e4faf5d-7860-416f-a52b-2d665941683e service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:01.565366 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-d7217106-f72f-4718-a065-183965808923 req-9e4faf5d-7860-416f-a52b-2d665941683e service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:01.570147 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-903863db-d3d0-4b54-bfe4-da4eefaa6656 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:01.575415 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-903863db-d3d0-4b54-bfe4-da4eefaa6656 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:01.575415 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-903863db-d3d0-4b54-bfe4-da4eefaa6656 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:01.575415 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-903863db-d3d0-4b54-bfe4-da4eefaa6656 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:01.580829 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-d7217106-f72f-4718-a065-183965808923 req-9e4faf5d-7860-416f-a52b-2d665941683e service nova] Creating event network-vif-deleted:c9743a5a-7193-4cc0-93e6-05a64a6339e1 for instance a8b767fd-1e8b-4b26-8c43-236c7698129e on hv-cinder-84178 May 13 17:36:01.593425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-d7217106-f72f-4718-a065-183965808923 req-9e4faf5d-7860-416f-a52b-2d665941683e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042312 May 13 17:36:01.595881 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 620/1226] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:36:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:36:01.761168 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ec301658-d678-4ce3-bd67-7524d06f5e99 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:01.761780 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ec301658-d678-4ce3-bd67-7524d06f5e99 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:01.768995 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ec301658-d678-4ce3-bd67-7524d06f5e99 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:01.770417 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ec301658-d678-4ce3-bd67-7524d06f5e99 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:01.771500 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ec301658-d678-4ce3-bd67-7524d06f5e99 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:01.772153 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ec301658-d678-4ce3-bd67-7524d06f5e99 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:01.810095 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-903863db-d3d0-4b54-bfe4-da4eefaa6656 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:01.822947 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-903863db-d3d0-4b54-bfe4-da4eefaa6656 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 200 len: 1267 microversion: 2.1 time: 0.280406 May 13 17:36:01.823563 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 607/1227] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:36:01 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 1267 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:36:01.878716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ec301658-d678-4ce3-bd67-7524d06f5e99 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:01.888072 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ec301658-d678-4ce3-bd67-7524d06f5e99 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e" status: 200 len: 1326 microversion: 2.1 time: 0.130954 May 13 17:36:01.888969 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 621/1228] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:36:01 2022] GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e => generated 1326 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:36:02.397968 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-be4d22ab-64c0-4305-82d1-1feeac177654 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:02.398720 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-be4d22ab-64c0-4305-82d1-1feeac177654 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:02.424970 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-be4d22ab-64c0-4305-82d1-1feeac177654 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:02.425598 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-be4d22ab-64c0-4305-82d1-1feeac177654 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:02.426558 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-be4d22ab-64c0-4305-82d1-1feeac177654 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:02.427400 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-be4d22ab-64c0-4305-82d1-1feeac177654 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:02.476407 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-be4d22ab-64c0-4305-82d1-1feeac177654 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a/ips" status: 200 len: 151 microversion: 2.20 time: 0.082125 May 13 17:36:02.480132 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 608/1229] 10.222.0.64 () {60 vars in 1288 bytes} [Fri May 13 17:36:02 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a/ips => generated 151 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 17:36:02.840410 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d01762f6-4b4e-4c1c-b20b-f6b493a23272 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:02.841018 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d01762f6-4b4e-4c1c-b20b-f6b493a23272 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:02.847296 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d01762f6-4b4e-4c1c-b20b-f6b493a23272 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:02.847744 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d01762f6-4b4e-4c1c-b20b-f6b493a23272 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:02.848500 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d01762f6-4b4e-4c1c-b20b-f6b493a23272 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:02.848934 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d01762f6-4b4e-4c1c-b20b-f6b493a23272 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:02.908383 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-2e29d978-6cca-45bb-b954-39793f6c074a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:02.909004 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-2e29d978-6cca-45bb-b954-39793f6c074a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:02.917424 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2e29d978-6cca-45bb-b954-39793f6c074a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:02.918658 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2e29d978-6cca-45bb-b954-39793f6c074a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:02.919728 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2e29d978-6cca-45bb-b954-39793f6c074a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:02.921537 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2e29d978-6cca-45bb-b954-39793f6c074a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:03.000164 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2e29d978-6cca-45bb-b954-39793f6c074a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:03.000618 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2e29d978-6cca-45bb-b954-39793f6c074a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:03.001076 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.objects.instance [None req-2e29d978-6cca-45bb-b954-39793f6c074a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lazy-loading 'fault' on Instance uuid a8b767fd-1e8b-4b26-8c43-236c7698129e {{(pid=117492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:36:03.078352 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d01762f6-4b4e-4c1c-b20b-f6b493a23272 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:03.086134 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d01762f6-4b4e-4c1c-b20b-f6b493a23272 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 200 len: 1454 microversion: 2.1 time: 0.249505 May 13 17:36:03.087767 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 622/1230] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:36:02 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 1454 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:36:03.091764 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-2e29d978-6cca-45bb-b954-39793f6c074a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:03.110089 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a0d10250-9540-42c7-8179-4b9c6d809b3f tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:03.113671 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-2e29d978-6cca-45bb-b954-39793f6c074a tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e" status: 200 len: 1331 microversion: 2.1 time: 0.208325 May 13 17:36:03.113796 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a0d10250-9540-42c7-8179-4b9c6d809b3f tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:03.115135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 609/1231] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:36:02 2022] GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e => generated 1331 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:36:03.119664 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a0d10250-9540-42c7-8179-4b9c6d809b3f tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:03.120376 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a0d10250-9540-42c7-8179-4b9c6d809b3f tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:03.121415 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a0d10250-9540-42c7-8179-4b9c6d809b3f tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:03.122070 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a0d10250-9540-42c7-8179-4b9c6d809b3f tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:03.323148 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a0d10250-9540-42c7-8179-4b9c6d809b3f tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:03.331844 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a0d10250-9540-42c7-8179-4b9c6d809b3f tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 200 len: 1454 microversion: 2.1 time: 0.227004 May 13 17:36:03.332992 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 623/1232] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:36:03 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 1454 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:36:04.129334 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-82737923-b6e7-4af9-bd42-67edf2a75754 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:04.130656 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-82737923-b6e7-4af9-bd42-67edf2a75754 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:04.137736 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-82737923-b6e7-4af9-bd42-67edf2a75754 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:04.138463 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-82737923-b6e7-4af9-bd42-67edf2a75754 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:04.140589 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-82737923-b6e7-4af9-bd42-67edf2a75754 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:04.140768 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-82737923-b6e7-4af9-bd42-67edf2a75754 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:04.156891 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-82737923-b6e7-4af9-bd42-67edf2a75754 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] HTTP exception thrown: Instance a8b767fd-1e8b-4b26-8c43-236c7698129e could not be found. May 13 17:36:04.160081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-82737923-b6e7-4af9-bd42-67edf2a75754 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Request method failure captured: May 13 17:36:04.160081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e HTTP/1.1 May 13 17:36:04.160081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:36:04.160081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:36:04.160081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:36:04.160081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 0 May 13 17:36:04.160081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:36:04.160081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:36:04.160081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:36:04.160081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:36:04.160081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpTc_RrVmxy2iGzrfQJ2JGoLflGoXwQ8zHwIs9aTMpqZXeC78NlpwKZWhCbBdWoUAU_vvb08rrsxX0JsiGqFmgTgDrNVuDQuL1AnwToYH23sqxxCURxc3AiIzkc2Y-1ZSXLpS2OklBXtojTSGTsLp1Uq6KzyDltfns2DlgjWoGsxMc0 May 13 17:36:04.160081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:36:04.160081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:36:04.160081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:36:04.160081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:36:04.160081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:36:04.160081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:36:04.160081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: ae7b37b41d944427945d783a460ca12a May 13 17:36:04.160081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:36:04.160081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:36:04.160081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:36:04.161705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ae7b37b41d944427945d783a460ca12a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}] May 13 17:36:04.161705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-AttachVolumeNegativeTest-908235212 May 13 17:36:04.161705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: ae7b37b41d944427945d783a460ca12a May 13 17:36:04.161705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:36:04.161705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:36:04.161705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:36:04.161705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:36:04.161705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: dfc52b61bcf845d1953a5a111abb3666 May 13 17:36:04.161705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:36:04.161705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: > May 13 17:36:04.161705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Instance a8b767fd-1e8b-4b26-8c43-236c7698129e could not be found. May 13 17:36:04.161705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'id': 'a8b767fd-1e8b-4b26-8c43-236c7698129e'} May 13 17:36:04.162829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:36:04.162829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:36:04.162829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:36:04.162829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:36:04.162829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:36:04.162829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:36:04.162829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:36:04.162829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:36:04.162829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:36:04.162829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:36:04.162829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8b767fd-1e8b-4b26-8c43-236c7698129e could not be found. May 13 17:36:04.162829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:36:04.162829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:36:04.162829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:36:04.162829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:36:04.162829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:36:04.162829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:36:04.162829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:36:04.162829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:36:04.162829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:36:04.164487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:36:04.164487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:36:04.164487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:36:04.164487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:36:04.164487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:36:04.164487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:36:04.164487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:36:04.164487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8b767fd-1e8b-4b26-8c43-236c7698129e could not be found. May 13 17:36:04.164487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:36:04.164487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:36:04.164487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:36:04.164487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:36:04.164487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:36:04.164487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:36:04.164487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:36:04.164487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:36:04.164487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8b767fd-1e8b-4b26-8c43-236c7698129e could not be found. May 13 17:36:04.164487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:36:04.166393 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-82737923-b6e7-4af9-bd42-67edf2a75754 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Returning 404 to user: Instance a8b767fd-1e8b-4b26-8c43-236c7698129e could not be found. {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:36:04.166393 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-82737923-b6e7-4af9-bd42-67edf2a75754 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e" status: 404 len: 111 microversion: 2.1 time: 0.039824 May 13 17:36:04.167628 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 610/1233] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:36:04 2022] GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:36:04.178785 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-458a05cc-f08e-4b76-bb7a-eebf1c1b49a2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '.version_select at 0x7fa08423ce50>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:04.267722 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-458a05cc-f08e-4b76-bb7a-eebf1c1b49a2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-462924621" status: 202 len: 0 microversion: 2.1 time: 0.093847 May 13 17:36:04.268115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 624/1234] 10.222.0.64 () {58 vars in 1217 bytes} [Fri May 13 17:36:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-462924621 => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 17:36:05.363065 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3c3baf16-5cd3-4537-a51b-04195abc90c2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Action: 'create', calling method: .version_select at 0x7fa084b18430>, body: {"keypair": {"name": "tempest-keypair-86172652", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF4m3/Zn64y2U+Pjl1JqccsW8stXpp4pY+M38QCY2TNyi1aDcvNYdzHAZXZmAMK4RDhxTCUiFKNXGV7OQoY7in0bcsq5iN3oB4iHlpBpjjS1zQ1lLVyHs456Mx3PT5ImLQ=="}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:36:05.379085 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-3c3baf16-5cd3-4537-a51b-04195abc90c2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Getting quotas for project ae7b37b41d944427945d783a460ca12a. Resources: {'key_pairs'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:36:05.383004 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-3c3baf16-5cd3-4537-a51b-04195abc90c2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Getting quotas for user dfc52b61bcf845d1953a5a111abb3666 and project ae7b37b41d944427945d783a460ca12a. Resources: {'key_pairs'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:36:05.453824 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3c3baf16-5cd3-4537-a51b-04195abc90c2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.094536 May 13 17:36:05.459983 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 611/1235] 10.222.0.64 () {60 vars in 1158 bytes} [Fri May 13 17:36:05 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:36:05.903936 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-626a47a0-e023-461f-bfd8-56ac85e32bed req-83b16792-d2c4-4266-a6b7-5a3f9ff6b48e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "28943379-c589-47c4-939d-c9c2b0e67b7f", "tag": "ec51b328-6c86-4e0d-9a2e-180d591317ab"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:36:05.923022 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-626a47a0-e023-461f-bfd8-56ac85e32bed req-83b16792-d2c4-4266-a6b7-5a3f9ff6b48e service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:05.923022 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-626a47a0-e023-461f-bfd8-56ac85e32bed req-83b16792-d2c4-4266-a6b7-5a3f9ff6b48e service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:05.929980 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-626a47a0-e023-461f-bfd8-56ac85e32bed req-83b16792-d2c4-4266-a6b7-5a3f9ff6b48e service nova] Creating event network-changed:ec51b328-6c86-4e0d-9a2e-180d591317ab for instance 28943379-c589-47c4-939d-c9c2b0e67b7f on hv-cinder-84178 May 13 17:36:05.949465 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-05733ebd-a0c3-4408-a29e-686120a596b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:36:05.950019 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-05733ebd-a0c3-4408-a29e-686120a596b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:05.964754 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-626a47a0-e023-461f-bfd8-56ac85e32bed req-83b16792-d2c4-4266-a6b7-5a3f9ff6b48e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056208 May 13 17:36:05.964754 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 625/1236] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:36:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:36:05.965420 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-05733ebd-a0c3-4408-a29e-686120a596b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:05.965420 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-05733ebd-a0c3-4408-a29e-686120a596b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:05.965420 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-05733ebd-a0c3-4408-a29e-686120a596b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:05.965688 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-05733ebd-a0c3-4408-a29e-686120a596b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:06.013306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.objects.instance [None req-05733ebd-a0c3-4408-a29e-686120a596b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lazy-loading 'flavor' on Instance uuid 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a {{(pid=117492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:36:06.395743 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e8aec9a1-2765-409e-ad8d-06cc827e284b tempest-VolumesGetTestJSON-1510022825 tempest-VolumesGetTestJSON-1510022825-project] Action: 'create', calling method: .version_select at 0x7fa084399670>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-387727767", "metadata": {"Type": "work"}}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:36:06.657060 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-05733ebd-a0c3-4408-a29e-686120a596b6 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "POST /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a/action" status: 202 len: 0 microversion: 2.20 time: 0.718431 May 13 17:36:06.661094 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 612/1237] 10.222.0.64 () {62 vars in 1318 bytes} [Fri May 13 17:36:05 2022] POST /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a/action => generated 0 bytes in 723 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 17:36:06.666782 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-5f0085be-c7b3-4fbf-ab4b-6d5b29e389bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:06.668336 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-5f0085be-c7b3-4fbf-ab4b-6d5b29e389bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:06.675757 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5f0085be-c7b3-4fbf-ab4b-6d5b29e389bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:06.676290 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5f0085be-c7b3-4fbf-ab4b-6d5b29e389bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:06.677080 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5f0085be-c7b3-4fbf-ab4b-6d5b29e389bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:06.677520 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5f0085be-c7b3-4fbf-ab4b-6d5b29e389bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:06.870496 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-5f0085be-c7b3-4fbf-ab4b-6d5b29e389bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:06.882122 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-5f0085be-c7b3-4fbf-ab4b-6d5b29e389bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:06.888778 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-5f0085be-c7b3-4fbf-ab4b-6d5b29e389bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:06.888778 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-5f0085be-c7b3-4fbf-ab4b-6d5b29e389bf tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1724 microversion: 2.20 time: 0.224278 May 13 17:36:06.888778 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 613/1238] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:06 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1724 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:07.163119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e8aec9a1-2765-409e-ad8d-06cc827e284b tempest-VolumesGetTestJSON-1510022825 tempest-VolumesGetTestJSON-1510022825-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.913054 May 13 17:36:07.165285 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 626/1239] 10.222.0.64 () {60 vars in 1155 bytes} [Fri May 13 17:36:06 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 917 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 13 17:36:07.176291 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-54f6534b-41df-48e0-a2a4-0cf88074da04 tempest-VolumesGetTestJSON-1510022825 tempest-VolumesGetTestJSON-1510022825-project] Calling method '.version_select at 0x7fa084cbb3a0>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:07.224897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-54f6534b-41df-48e0-a2a4-0cf88074da04 tempest-VolumesGetTestJSON-1510022825 tempest-VolumesGetTestJSON-1510022825-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/010b6111-a446-4f79-8676-291fb4cac449" status: 200 len: 352 microversion: 2.1 time: 0.052793 May 13 17:36:07.225478 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 614/1240] 10.222.0.64 () {58 vars in 1244 bytes} [Fri May 13 17:36:07 2022] GET /compute/v2.1/os-volumes/010b6111-a446-4f79-8676-291fb4cac449 => generated 352 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:36:07.905691 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6d7ecfb9-208b-4917-8996-37960c8d465c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:07.906427 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6d7ecfb9-208b-4917-8996-37960c8d465c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:07.913451 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6d7ecfb9-208b-4917-8996-37960c8d465c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:07.913908 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6d7ecfb9-208b-4917-8996-37960c8d465c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:07.914688 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6d7ecfb9-208b-4917-8996-37960c8d465c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:07.915157 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6d7ecfb9-208b-4917-8996-37960c8d465c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:08.057670 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6d7ecfb9-208b-4917-8996-37960c8d465c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:08.066009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6d7ecfb9-208b-4917-8996-37960c8d465c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:08.067546 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6d7ecfb9-208b-4917-8996-37960c8d465c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:08.068740 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6d7ecfb9-208b-4917-8996-37960c8d465c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1724 microversion: 2.20 time: 0.167183 May 13 17:36:08.069371 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 627/1241] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:07 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:08.183478 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b317f9a6-b4ca-4c14-8680-1c186e8095e2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1878795393", "imageRef": "7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "88108179-f685-4c21-8286-b31593459871"}], "security_groups": [{"name": "tempest-securitygroup--1682122084"}], "key_name": "tempest-keypair-86172652", "user_data": "}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:36:08.238701 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b1231c58-c609-446d-ab33-7a5acacec5a2 tempest-VolumesGetTestJSON-1510022825 tempest-VolumesGetTestJSON-1510022825-project] Calling method '.version_select at 0x7fa084411040>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:08.284997 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.network.neutron [None req-b317f9a6-b4ca-4c14-8680-1c186e8095e2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] validate_networks() for [('88108179-f685-4c21-8286-b31593459871', None, None, None, None, None)] {{(pid=117492) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 17:36:08.285888 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b1231c58-c609-446d-ab33-7a5acacec5a2 tempest-VolumesGetTestJSON-1510022825 tempest-VolumesGetTestJSON-1510022825-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/010b6111-a446-4f79-8676-291fb4cac449" status: 200 len: 353 microversion: 2.1 time: 0.052399 May 13 17:36:08.286470 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 628/1242] 10.222.0.64 () {58 vars in 1244 bytes} [Fri May 13 17:36:08 2022] GET /compute/v2.1/os-volumes/010b6111-a446-4f79-8676-291fb4cac449 => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:36:08.297760 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fce91831-a38a-4e9e-84e7-bce56bcc8987 tempest-VolumesGetTestJSON-1510022825 tempest-VolumesGetTestJSON-1510022825-project] Calling method '.version_select at 0x7fa0843441f0>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:08.343767 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fce91831-a38a-4e9e-84e7-bce56bcc8987 tempest-VolumesGetTestJSON-1510022825 tempest-VolumesGetTestJSON-1510022825-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/010b6111-a446-4f79-8676-291fb4cac449" status: 200 len: 353 microversion: 2.1 time: 0.050273 May 13 17:36:08.344332 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 629/1243] 10.222.0.64 () {58 vars in 1244 bytes} [Fri May 13 17:36:08 2022] GET /compute/v2.1/os-volumes/010b6111-a446-4f79-8676-291fb4cac449 => generated 353 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:36:08.360783 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a97b0526-55d0-4fa2-8aa1-da7f896166c6 tempest-VolumesGetTestJSON-1510022825 tempest-VolumesGetTestJSON-1510022825-project] Calling method '.version_select at 0x7fa084399700>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:08.572465 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a97b0526-55d0-4fa2-8aa1-da7f896166c6 tempest-VolumesGetTestJSON-1510022825 tempest-VolumesGetTestJSON-1510022825-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/010b6111-a446-4f79-8676-291fb4cac449" status: 202 len: 0 microversion: 2.1 time: 0.215830 May 13 17:36:08.573436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 630/1244] 10.222.0.64 () {58 vars in 1247 bytes} [Fri May 13 17:36:08 2022] DELETE /compute/v2.1/os-volumes/010b6111-a446-4f79-8676-291fb4cac449 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 13 17:36:08.581947 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5c2d66c7-0c05-4065-8ff4-1cfaae872c5c tempest-VolumesGetTestJSON-1510022825 tempest-VolumesGetTestJSON-1510022825-project] Calling method '.version_select at 0x7fa084344280>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:08.628176 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5c2d66c7-0c05-4065-8ff4-1cfaae872c5c tempest-VolumesGetTestJSON-1510022825 tempest-VolumesGetTestJSON-1510022825-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/010b6111-a446-4f79-8676-291fb4cac449" status: 200 len: 352 microversion: 2.1 time: 0.049871 May 13 17:36:08.628788 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 631/1245] 10.222.0.64 () {58 vars in 1244 bytes} [Fri May 13 17:36:08 2022] GET /compute/v2.1/os-volumes/010b6111-a446-4f79-8676-291fb4cac449 => generated 352 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:36:08.656051 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-b317f9a6-b4ca-4c14-8680-1c186e8095e2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Flavor limits 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 17:36:08.656482 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-b317f9a6-b4ca-4c14-8680-1c186e8095e2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Image limits 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 17:36:08.657951 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-b317f9a6-b4ca-4c14-8680-1c186e8095e2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Flavor pref 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 17:36:08.657951 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-b317f9a6-b4ca-4c14-8680-1c186e8095e2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Image pref 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 17:36:08.657951 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-b317f9a6-b4ca-4c14-8680-1c186e8095e2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 17:36:08.666371 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b317f9a6-b4ca-4c14-8680-1c186e8095e2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:08.666823 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b317f9a6-b4ca-4c14-8680-1c186e8095e2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:08.667664 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b317f9a6-b4ca-4c14-8680-1c186e8095e2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:08.668105 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b317f9a6-b4ca-4c14-8680-1c186e8095e2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:08.684155 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-b317f9a6-b4ca-4c14-8680-1c186e8095e2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Getting quotas for project ae7b37b41d944427945d783a460ca12a. Resources: {'ram', 'instances', 'cores'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:36:08.688059 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-b317f9a6-b4ca-4c14-8680-1c186e8095e2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Getting quotas for user dfc52b61bcf845d1953a5a111abb3666 and project ae7b37b41d944427945d783a460ca12a. Resources: {'ram', 'instances', 'cores'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:36:08.698784 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b317f9a6-b4ca-4c14-8680-1c186e8095e2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Going to run 1 instances... {{(pid=117492) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 17:36:08.701096 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b317f9a6-b4ca-4c14-8680-1c186e8095e2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7e16ecb1-06ad-4042-b3b8-dacbe5ef0c88',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 17:36:08.808410 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b317f9a6-b4ca-4c14-8680-1c186e8095e2 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.629676 May 13 17:36:08.809101 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 615/1246] 10.222.0.64 () {60 vars in 1146 bytes} [Fri May 13 17:36:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 17:36:08.819016 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-99fdc366-a78c-4b36-a47e-10e2d9e6571e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:08.819913 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-99fdc366-a78c-4b36-a47e-10e2d9e6571e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:08.872601 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-99fdc366-a78c-4b36-a47e-10e2d9e6571e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:08.879950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-99fdc366-a78c-4b36-a47e-10e2d9e6571e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504" status: 200 len: 1240 microversion: 2.1 time: 0.064791 May 13 17:36:08.880516 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 632/1247] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:36:08 2022] GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504 => generated 1240 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:36:09.087240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6fb3484d-4494-4ab5-ad7c-57cf1bc018c1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:09.087844 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6fb3484d-4494-4ab5-ad7c-57cf1bc018c1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:09.095398 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6fb3484d-4494-4ab5-ad7c-57cf1bc018c1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:09.100982 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6fb3484d-4494-4ab5-ad7c-57cf1bc018c1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:09.100982 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6fb3484d-4494-4ab5-ad7c-57cf1bc018c1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:09.100982 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6fb3484d-4494-4ab5-ad7c-57cf1bc018c1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:09.231363 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6fb3484d-4494-4ab5-ad7c-57cf1bc018c1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:09.239640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6fb3484d-4494-4ab5-ad7c-57cf1bc018c1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:09.241127 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6fb3484d-4494-4ab5-ad7c-57cf1bc018c1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:09.242289 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6fb3484d-4494-4ab5-ad7c-57cf1bc018c1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1724 microversion: 2.20 time: 0.158979 May 13 17:36:09.242871 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 616/1248] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:09 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:09.639835 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fdc5e78a-d237-4d93-bc68-cc1bd86746aa tempest-VolumesGetTestJSON-1510022825 tempest-VolumesGetTestJSON-1510022825-project] Calling method '.version_select at 0x7fa084411940>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:09.667766 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-fdc5e78a-d237-4d93-bc68-cc1bd86746aa tempest-VolumesGetTestJSON-1510022825 tempest-VolumesGetTestJSON-1510022825-project] HTTP exception thrown: Volume 010b6111-a446-4f79-8676-291fb4cac449 could not be found. May 13 17:36:09.670188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fdc5e78a-d237-4d93-bc68-cc1bd86746aa tempest-VolumesGetTestJSON-1510022825 tempest-VolumesGetTestJSON-1510022825-project] Request method failure captured: May 13 17:36:09.670188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/os-volumes/010b6111-a446-4f79-8676-291fb4cac449 HTTP/1.1 May 13 17:36:09.670188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:36:09.670188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:36:09.670188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:36:09.670188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:36:09.670188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:36:09.670188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:36:09.670188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:36:09.670188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:36:09.670188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpcG13ofA7_nLNbB6opH2tQIr92XhtenPKE3SuFIqXr7vdRcUsAdZzw_c8yeRBcp2DeuMLgSnzQxONcvGBXgnDID0HP8M5QTQ1Jllk0gggloXHk6i_2p_YAQLpp_qXgHwXBBQKbigquEpvehe_As1cgu5CRTc_MCXEZrKTPcxVK5J-Y May 13 17:36:09.670188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:36:09.670188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:36:09.670188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:36:09.670188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:36:09.670188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:36:09.670188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:36:09.670188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: d2bb6994f7ba41a6b1357dcada96a806 May 13 17:36:09.670188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-VolumesGetTestJSON-1510022825 May 13 17:36:09.670188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:36:09.670188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:36:09.672416 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/d2bb6994f7ba41a6b1357dcada96a806"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d2bb6994f7ba41a6b1357dcada96a806"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_d2bb6994f7ba41a6b1357dcada96a806"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/d2bb6994f7ba41a6b1357dcada96a806"}]}] May 13 17:36:09.672416 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-VolumesGetTestJSON-1510022825 May 13 17:36:09.672416 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: d2bb6994f7ba41a6b1357dcada96a806 May 13 17:36:09.672416 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-VolumesGetTestJSON-1510022825 May 13 17:36:09.672416 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-VolumesGetTestJSON-1510022825-project May 13 17:36:09.672416 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:36:09.672416 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:36:09.672416 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: 78d4025c721647428b799ca0e159c0c6 May 13 17:36:09.672416 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-VolumesGetTestJSON-1510022825-project May 13 17:36:09.672416 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: May 13 17:36:09.672416 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Volume 010b6111-a446-4f79-8676-291fb4cac449 could not be found. May 13 17:36:09.672416 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '010b6111-a446-4f79-8676-291fb4cac449'} May 13 17:36:09.672416 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:36:09.673374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:36:09.673374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 17:36:09.673374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 17:36:09.673374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 17:36:09.673374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 17:36:09.673374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 17:36:09.673374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 17:36:09.673374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 17:36:09.673374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 17:36:09.673374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 17:36:09.673374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 17:36:09.673374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 17:36:09.673374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 17:36:09.673374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 17:36:09.673374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 17:36:09.673374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 010b6111-a446-4f79-8676-291fb4cac449 could not be found. (HTTP 404) (Request-ID: req-4e1fd6b2-1e1f-4ae3-95d5-dffdd2f145cc) May 13 17:36:09.673374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:36:09.673374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:36:09.673374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:36:09.674873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:36:09.674873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 13 17:36:09.674873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 13 17:36:09.674873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 13 17:36:09.674873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 13 17:36:09.674873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 13 17:36:09.674873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 13 17:36:09.674873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 13 17:36:09.674873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 13 17:36:09.674873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 13 17:36:09.674873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 13 17:36:09.674873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 13 17:36:09.674873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi item = cinderclient( May 13 17:36:09.674873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 13 17:36:09.674873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 13 17:36:09.674873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 13 17:36:09.674873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 13 17:36:09.674873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 13 17:36:09.674873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 13 17:36:09.676253 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 13 17:36:09.676253 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 13 17:36:09.676253 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 13 17:36:09.676253 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 13 17:36:09.676253 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 010b6111-a446-4f79-8676-291fb4cac449 could not be found. May 13 17:36:09.676253 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:36:09.676253 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:36:09.676253 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:36:09.676253 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:36:09.676253 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:36:09.676253 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:36:09.676253 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:36:09.676253 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:36:09.676253 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 13 17:36:09.676253 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 13 17:36:09.676253 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:36:09.676253 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:36:09.676253 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 13 17:36:09.676253 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:36:09.677651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 010b6111-a446-4f79-8676-291fb4cac449 could not be found. May 13 17:36:09.677651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:36:09.677651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:36:09.677651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:36:09.677651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:36:09.677651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:36:09.677651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:36:09.677651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:36:09.677651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:36:09.677651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 010b6111-a446-4f79-8676-291fb4cac449 could not be found. May 13 17:36:09.677651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:36:09.677651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fdc5e78a-d237-4d93-bc68-cc1bd86746aa tempest-VolumesGetTestJSON-1510022825 tempest-VolumesGetTestJSON-1510022825-project] Returning 404 to user: Volume 010b6111-a446-4f79-8676-291fb4cac449 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:36:09.677651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fdc5e78a-d237-4d93-bc68-cc1bd86746aa tempest-VolumesGetTestJSON-1510022825 tempest-VolumesGetTestJSON-1510022825-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/010b6111-a446-4f79-8676-291fb4cac449" status: 404 len: 109 microversion: 2.1 time: 0.036332 May 13 17:36:09.677651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 633/1249] 10.222.0.64 () {58 vars in 1244 bytes} [Fri May 13 17:36:09 2022] GET /compute/v2.1/os-volumes/010b6111-a446-4f79-8676-291fb4cac449 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:36:09.896846 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-bee3ba81-97c1-4ae0-b2ff-8657e258bf9c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:09.897454 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-bee3ba81-97c1-4ae0-b2ff-8657e258bf9c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:09.903739 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bee3ba81-97c1-4ae0-b2ff-8657e258bf9c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:09.904191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bee3ba81-97c1-4ae0-b2ff-8657e258bf9c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:09.904956 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bee3ba81-97c1-4ae0-b2ff-8657e258bf9c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:09.905422 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bee3ba81-97c1-4ae0-b2ff-8657e258bf9c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:09.966346 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-bee3ba81-97c1-4ae0-b2ff-8657e258bf9c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:09.973865 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-bee3ba81-97c1-4ae0-b2ff-8657e258bf9c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504" status: 200 len: 1236 microversion: 2.1 time: 0.080924 May 13 17:36:09.974432 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 617/1250] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:36:09 2022] GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504 => generated 1236 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:36:10.260908 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2db93789-7f3b-4f9c-871d-fefc0f4e3fd5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:10.261856 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2db93789-7f3b-4f9c-871d-fefc0f4e3fd5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:10.268733 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2db93789-7f3b-4f9c-871d-fefc0f4e3fd5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:10.269181 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2db93789-7f3b-4f9c-871d-fefc0f4e3fd5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:10.274428 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2db93789-7f3b-4f9c-871d-fefc0f4e3fd5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:10.274428 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2db93789-7f3b-4f9c-871d-fefc0f4e3fd5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:10.435742 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2db93789-7f3b-4f9c-871d-fefc0f4e3fd5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:10.445280 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2db93789-7f3b-4f9c-871d-fefc0f4e3fd5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:10.446993 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2db93789-7f3b-4f9c-871d-fefc0f4e3fd5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:10.448611 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2db93789-7f3b-4f9c-871d-fefc0f4e3fd5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1724 microversion: 2.20 time: 0.191619 May 13 17:36:10.449243 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 634/1251] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:10 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1724 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:11.011895 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b63ddbe8-9795-417c-8fca-b44303848bff tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:11.011895 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b63ddbe8-9795-417c-8fca-b44303848bff tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:11.011895 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b63ddbe8-9795-417c-8fca-b44303848bff tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:11.011895 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b63ddbe8-9795-417c-8fca-b44303848bff tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:11.013046 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b63ddbe8-9795-417c-8fca-b44303848bff tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:11.013046 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b63ddbe8-9795-417c-8fca-b44303848bff tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:11.083153 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b63ddbe8-9795-417c-8fca-b44303848bff tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:11.090682 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b63ddbe8-9795-417c-8fca-b44303848bff tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504" status: 200 len: 1310 microversion: 2.1 time: 0.097627 May 13 17:36:11.091273 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 618/1252] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:36:10 2022] GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504 => generated 1310 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:36:11.465703 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b1b98a6a-b4e2-43b0-a97c-022712a4358b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:11.466309 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b1b98a6a-b4e2-43b0-a97c-022712a4358b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:11.473440 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b1b98a6a-b4e2-43b0-a97c-022712a4358b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:11.473900 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b1b98a6a-b4e2-43b0-a97c-022712a4358b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:11.474706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b1b98a6a-b4e2-43b0-a97c-022712a4358b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:11.475157 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b1b98a6a-b4e2-43b0-a97c-022712a4358b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:11.691466 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b1b98a6a-b4e2-43b0-a97c-022712a4358b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:11.705268 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b1b98a6a-b4e2-43b0-a97c-022712a4358b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:11.706800 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b1b98a6a-b4e2-43b0-a97c-022712a4358b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:11.708657 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b1b98a6a-b4e2-43b0-a97c-022712a4358b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1724 microversion: 2.20 time: 0.246628 May 13 17:36:11.710610 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 635/1253] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:11 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1724 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:12.110197 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-40305d2b-16f8-45f7-81d4-3d9c4a0af516 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:12.110990 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-40305d2b-16f8-45f7-81d4-3d9c4a0af516 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:12.117578 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-40305d2b-16f8-45f7-81d4-3d9c4a0af516 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:12.118023 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-40305d2b-16f8-45f7-81d4-3d9c4a0af516 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:12.118790 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-40305d2b-16f8-45f7-81d4-3d9c4a0af516 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:12.119257 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-40305d2b-16f8-45f7-81d4-3d9c4a0af516 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:12.254910 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-40305d2b-16f8-45f7-81d4-3d9c4a0af516 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:12.262121 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-40305d2b-16f8-45f7-81d4-3d9c4a0af516 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504" status: 200 len: 1366 microversion: 2.1 time: 0.156225 May 13 17:36:12.263782 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 619/1254] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:36:12 2022] GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:36:12.625976 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-9f012a9e-ae51-44b2-aca1-5e427177fea9 req-f07e5d62-7dce-463a-9da7-5488c190af76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3946add-9fd1-4b68-815a-b2f91ff85504", "tag": "3f4c19e6-a6aa-42e2-8c1b-98a74f543196"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:36:12.634189 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-9f012a9e-ae51-44b2-aca1-5e427177fea9 req-f07e5d62-7dce-463a-9da7-5488c190af76 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:12.634794 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-9f012a9e-ae51-44b2-aca1-5e427177fea9 req-f07e5d62-7dce-463a-9da7-5488c190af76 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:12.648831 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-9f012a9e-ae51-44b2-aca1-5e427177fea9 req-f07e5d62-7dce-463a-9da7-5488c190af76 service nova] Creating event network-changed:3f4c19e6-a6aa-42e2-8c1b-98a74f543196 for instance e3946add-9fd1-4b68-815a-b2f91ff85504 on hv-cinder-84178 May 13 17:36:12.654132 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-9f012a9e-ae51-44b2-aca1-5e427177fea9 req-f07e5d62-7dce-463a-9da7-5488c190af76 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038864 May 13 17:36:12.655349 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 636/1255] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:36:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:36:12.729824 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-c3c86b56-7d3d-46c7-ba24-326fd90f2060 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:12.730535 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-c3c86b56-7d3d-46c7-ba24-326fd90f2060 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:12.746535 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c3c86b56-7d3d-46c7-ba24-326fd90f2060 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:12.746996 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c3c86b56-7d3d-46c7-ba24-326fd90f2060 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:12.747820 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c3c86b56-7d3d-46c7-ba24-326fd90f2060 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:12.748259 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c3c86b56-7d3d-46c7-ba24-326fd90f2060 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:12.898651 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c3c86b56-7d3d-46c7-ba24-326fd90f2060 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:12.907353 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c3c86b56-7d3d-46c7-ba24-326fd90f2060 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:12.908837 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c3c86b56-7d3d-46c7-ba24-326fd90f2060 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:12.910034 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-c3c86b56-7d3d-46c7-ba24-326fd90f2060 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1724 microversion: 2.20 time: 0.185625 May 13 17:36:12.910633 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 620/1256] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:12 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:13.280678 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-cea9a721-2267-419d-8843-9b961e7e5aeb tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:13.281622 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-cea9a721-2267-419d-8843-9b961e7e5aeb tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:13.287852 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cea9a721-2267-419d-8843-9b961e7e5aeb tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:13.288615 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cea9a721-2267-419d-8843-9b961e7e5aeb tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:13.289601 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cea9a721-2267-419d-8843-9b961e7e5aeb tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:13.290105 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cea9a721-2267-419d-8843-9b961e7e5aeb tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:13.507707 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-cea9a721-2267-419d-8843-9b961e7e5aeb tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:13.516231 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-cea9a721-2267-419d-8843-9b961e7e5aeb tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504" status: 200 len: 1366 microversion: 2.1 time: 0.240345 May 13 17:36:13.517064 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 637/1257] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:36:13 2022] GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:36:13.928699 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-32f1e5a4-61bc-469b-9e95-b16571e1ba20 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:13.929314 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-32f1e5a4-61bc-469b-9e95-b16571e1ba20 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:13.935724 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-32f1e5a4-61bc-469b-9e95-b16571e1ba20 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:13.936751 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-32f1e5a4-61bc-469b-9e95-b16571e1ba20 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:13.937546 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-32f1e5a4-61bc-469b-9e95-b16571e1ba20 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:13.937989 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-32f1e5a4-61bc-469b-9e95-b16571e1ba20 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:14.067388 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-32f1e5a4-61bc-469b-9e95-b16571e1ba20 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:14.075170 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-32f1e5a4-61bc-469b-9e95-b16571e1ba20 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:14.076686 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-32f1e5a4-61bc-469b-9e95-b16571e1ba20 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:14.077857 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-32f1e5a4-61bc-469b-9e95-b16571e1ba20 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1724 microversion: 2.20 time: 0.153066 May 13 17:36:14.078419 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 621/1258] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:13 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:14.533101 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9487fa06-acdb-4d41-979a-be077649abad tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:14.533774 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9487fa06-acdb-4d41-979a-be077649abad tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:14.540115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9487fa06-acdb-4d41-979a-be077649abad tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:14.540628 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9487fa06-acdb-4d41-979a-be077649abad tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:14.541391 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9487fa06-acdb-4d41-979a-be077649abad tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:14.541824 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9487fa06-acdb-4d41-979a-be077649abad tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:14.689722 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9487fa06-acdb-4d41-979a-be077649abad tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:14.696999 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9487fa06-acdb-4d41-979a-be077649abad tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504" status: 200 len: 1366 microversion: 2.1 time: 0.167835 May 13 17:36:14.698079 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 638/1259] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:36:14 2022] GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:36:15.096604 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-382d762c-c056-436c-b56d-3d4028540ef7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:15.097199 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-382d762c-c056-436c-b56d-3d4028540ef7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:15.103755 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-382d762c-c056-436c-b56d-3d4028540ef7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:15.105488 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-382d762c-c056-436c-b56d-3d4028540ef7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:15.105488 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-382d762c-c056-436c-b56d-3d4028540ef7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:15.105488 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-382d762c-c056-436c-b56d-3d4028540ef7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:15.232815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-382d762c-c056-436c-b56d-3d4028540ef7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:15.241216 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-382d762c-c056-436c-b56d-3d4028540ef7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:15.242699 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-382d762c-c056-436c-b56d-3d4028540ef7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:15.243925 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-382d762c-c056-436c-b56d-3d4028540ef7 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1724 microversion: 2.20 time: 0.151874 May 13 17:36:15.244484 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 622/1260] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:15 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:15.713673 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ac957b54-ebaf-4089-a457-21c1f28729a4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:15.714298 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ac957b54-ebaf-4089-a457-21c1f28729a4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:15.721240 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ac957b54-ebaf-4089-a457-21c1f28729a4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:15.721724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ac957b54-ebaf-4089-a457-21c1f28729a4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:15.722495 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ac957b54-ebaf-4089-a457-21c1f28729a4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:15.722929 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ac957b54-ebaf-4089-a457-21c1f28729a4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:15.857793 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ac957b54-ebaf-4089-a457-21c1f28729a4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:15.869250 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ac957b54-ebaf-4089-a457-21c1f28729a4 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504" status: 200 len: 1366 microversion: 2.1 time: 0.159363 May 13 17:36:15.869832 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 639/1261] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:36:15 2022] GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504 => generated 1366 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:36:16.265308 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b10bc5d2-7431-4e9b-be9f-819d4ca00c99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:16.265308 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b10bc5d2-7431-4e9b-be9f-819d4ca00c99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:16.270296 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b10bc5d2-7431-4e9b-be9f-819d4ca00c99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:16.270902 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b10bc5d2-7431-4e9b-be9f-819d4ca00c99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:16.271811 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b10bc5d2-7431-4e9b-be9f-819d4ca00c99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:16.272251 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b10bc5d2-7431-4e9b-be9f-819d4ca00c99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:16.404850 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b10bc5d2-7431-4e9b-be9f-819d4ca00c99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:16.412770 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b10bc5d2-7431-4e9b-be9f-819d4ca00c99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:16.414721 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b10bc5d2-7431-4e9b-be9f-819d4ca00c99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:16.415480 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b10bc5d2-7431-4e9b-be9f-819d4ca00c99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1724 microversion: 2.20 time: 0.157300 May 13 17:36:16.416032 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 623/1262] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:16 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:16.887417 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a4fd1e81-f582-4e28-ae9f-a80128ff01b1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:16.888004 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a4fd1e81-f582-4e28-ae9f-a80128ff01b1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:16.894130 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a4fd1e81-f582-4e28-ae9f-a80128ff01b1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:16.894577 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a4fd1e81-f582-4e28-ae9f-a80128ff01b1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:16.895361 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a4fd1e81-f582-4e28-ae9f-a80128ff01b1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:16.895862 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a4fd1e81-f582-4e28-ae9f-a80128ff01b1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:17.043063 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a4fd1e81-f582-4e28-ae9f-a80128ff01b1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:17.050963 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a4fd1e81-f582-4e28-ae9f-a80128ff01b1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504" status: 200 len: 1366 microversion: 2.1 time: 0.167378 May 13 17:36:17.051571 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 640/1263] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:36:16 2022] GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:36:17.433881 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-54f488b7-1c6d-4348-ad1c-1ac308bad8fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:17.434491 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-54f488b7-1c6d-4348-ad1c-1ac308bad8fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:17.440853 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-54f488b7-1c6d-4348-ad1c-1ac308bad8fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:17.441313 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-54f488b7-1c6d-4348-ad1c-1ac308bad8fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:17.442081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-54f488b7-1c6d-4348-ad1c-1ac308bad8fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:17.442521 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-54f488b7-1c6d-4348-ad1c-1ac308bad8fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:17.578545 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-54f488b7-1c6d-4348-ad1c-1ac308bad8fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:17.586682 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-54f488b7-1c6d-4348-ad1c-1ac308bad8fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:17.588227 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-54f488b7-1c6d-4348-ad1c-1ac308bad8fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:17.589493 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-54f488b7-1c6d-4348-ad1c-1ac308bad8fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1724 microversion: 2.20 time: 0.159677 May 13 17:36:17.590115 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 624/1264] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:17 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:18.067112 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3b4d17a8-bc7f-4b7a-a67d-2f542b9137e5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:18.071325 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3b4d17a8-bc7f-4b7a-a67d-2f542b9137e5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:18.074275 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3b4d17a8-bc7f-4b7a-a67d-2f542b9137e5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:18.074731 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3b4d17a8-bc7f-4b7a-a67d-2f542b9137e5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:18.075557 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3b4d17a8-bc7f-4b7a-a67d-2f542b9137e5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:18.075994 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3b4d17a8-bc7f-4b7a-a67d-2f542b9137e5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:18.212055 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3b4d17a8-bc7f-4b7a-a67d-2f542b9137e5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:18.219342 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3b4d17a8-bc7f-4b7a-a67d-2f542b9137e5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504" status: 200 len: 1366 microversion: 2.1 time: 0.156218 May 13 17:36:18.219908 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 641/1265] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:36:18 2022] GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:36:18.609194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-2903bb71-27c4-4501-8e8c-b9a6995b6214 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:18.609807 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-2903bb71-27c4-4501-8e8c-b9a6995b6214 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:18.616259 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2903bb71-27c4-4501-8e8c-b9a6995b6214 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:18.616709 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2903bb71-27c4-4501-8e8c-b9a6995b6214 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:18.617487 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2903bb71-27c4-4501-8e8c-b9a6995b6214 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:18.617936 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2903bb71-27c4-4501-8e8c-b9a6995b6214 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:18.702869 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-bfb19348-bff2-428f-9835-11c826168086 req-e52757bc-072b-48d0-b9fd-aaa1a4abe2a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3946add-9fd1-4b68-815a-b2f91ff85504", "name": "network-vif-plugged", "status": "completed", "tag": "3f4c19e6-a6aa-42e2-8c1b-98a74f543196"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:36:18.712169 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-bfb19348-bff2-428f-9835-11c826168086 req-e52757bc-072b-48d0-b9fd-aaa1a4abe2a2 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:18.712746 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-bfb19348-bff2-428f-9835-11c826168086 req-e52757bc-072b-48d0-b9fd-aaa1a4abe2a2 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:18.723895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-bfb19348-bff2-428f-9835-11c826168086 req-e52757bc-072b-48d0-b9fd-aaa1a4abe2a2 service nova] Creating event network-vif-plugged:3f4c19e6-a6aa-42e2-8c1b-98a74f543196 for instance e3946add-9fd1-4b68-815a-b2f91ff85504 on hv-cinder-84178 May 13 17:36:18.729197 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-bfb19348-bff2-428f-9835-11c826168086 req-e52757bc-072b-48d0-b9fd-aaa1a4abe2a2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030098 May 13 17:36:18.729779 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 642/1266] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:36:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:36:18.757569 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-2903bb71-27c4-4501-8e8c-b9a6995b6214 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:18.766093 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-2903bb71-27c4-4501-8e8c-b9a6995b6214 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:18.767628 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-2903bb71-27c4-4501-8e8c-b9a6995b6214 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:18.768801 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-2903bb71-27c4-4501-8e8c-b9a6995b6214 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1724 microversion: 2.20 time: 0.163704 May 13 17:36:18.769480 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 625/1267] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:18 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:19.237388 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b7c6f3aa-2346-41f9-a8a3-efc3cf4ca942 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:19.238114 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b7c6f3aa-2346-41f9-a8a3-efc3cf4ca942 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:19.244217 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b7c6f3aa-2346-41f9-a8a3-efc3cf4ca942 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:19.244667 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b7c6f3aa-2346-41f9-a8a3-efc3cf4ca942 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:19.245437 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b7c6f3aa-2346-41f9-a8a3-efc3cf4ca942 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:19.245870 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b7c6f3aa-2346-41f9-a8a3-efc3cf4ca942 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:19.377365 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b7c6f3aa-2346-41f9-a8a3-efc3cf4ca942 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:19.384726 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b7c6f3aa-2346-41f9-a8a3-efc3cf4ca942 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504" status: 200 len: 1366 microversion: 2.1 time: 0.152399 May 13 17:36:19.385300 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 643/1268] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:36:19 2022] GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:36:19.786288 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-68410423-bd3f-4cc1-af50-156e4a1f159f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:19.786862 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-68410423-bd3f-4cc1-af50-156e4a1f159f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:19.793303 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-68410423-bd3f-4cc1-af50-156e4a1f159f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:19.793757 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-68410423-bd3f-4cc1-af50-156e4a1f159f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:19.794529 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-68410423-bd3f-4cc1-af50-156e4a1f159f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:19.794995 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-68410423-bd3f-4cc1-af50-156e4a1f159f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:19.936314 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-68410423-bd3f-4cc1-af50-156e4a1f159f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:19.944701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-68410423-bd3f-4cc1-af50-156e4a1f159f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:19.946173 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-68410423-bd3f-4cc1-af50-156e4a1f159f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:19.947408 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-68410423-bd3f-4cc1-af50-156e4a1f159f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1724 microversion: 2.20 time: 0.165060 May 13 17:36:19.947973 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 626/1269] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:19 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:20.402738 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5728073e-0825-4e1e-b38c-feae12eac9a1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:20.403378 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5728073e-0825-4e1e-b38c-feae12eac9a1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:20.409874 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5728073e-0825-4e1e-b38c-feae12eac9a1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:20.410359 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5728073e-0825-4e1e-b38c-feae12eac9a1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:20.411147 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5728073e-0825-4e1e-b38c-feae12eac9a1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:20.411606 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5728073e-0825-4e1e-b38c-feae12eac9a1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:20.541528 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5728073e-0825-4e1e-b38c-feae12eac9a1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:20.549411 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5728073e-0825-4e1e-b38c-feae12eac9a1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504" status: 200 len: 1366 microversion: 2.1 time: 0.150495 May 13 17:36:20.549926 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 644/1270] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:36:20 2022] GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:36:20.966278 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6c4dfb43-83cd-46ed-8e4d-26bde6db8df2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:20.966985 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6c4dfb43-83cd-46ed-8e4d-26bde6db8df2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:20.973557 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6c4dfb43-83cd-46ed-8e4d-26bde6db8df2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:20.977496 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6c4dfb43-83cd-46ed-8e4d-26bde6db8df2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:20.977496 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6c4dfb43-83cd-46ed-8e4d-26bde6db8df2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:20.977496 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6c4dfb43-83cd-46ed-8e4d-26bde6db8df2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:21.114719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6c4dfb43-83cd-46ed-8e4d-26bde6db8df2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:21.123417 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6c4dfb43-83cd-46ed-8e4d-26bde6db8df2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:21.130462 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6c4dfb43-83cd-46ed-8e4d-26bde6db8df2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:21.131756 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6c4dfb43-83cd-46ed-8e4d-26bde6db8df2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1724 microversion: 2.20 time: 0.169594 May 13 17:36:21.132329 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 627/1271] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:20 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:21.566277 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-cc46f73e-e4c1-4bf0-82e7-1fc9f870f160 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:21.566810 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-cc46f73e-e4c1-4bf0-82e7-1fc9f870f160 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:21.573130 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cc46f73e-e4c1-4bf0-82e7-1fc9f870f160 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:21.573581 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cc46f73e-e4c1-4bf0-82e7-1fc9f870f160 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:21.574343 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cc46f73e-e4c1-4bf0-82e7-1fc9f870f160 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:21.574778 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cc46f73e-e4c1-4bf0-82e7-1fc9f870f160 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:21.703165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-cc46f73e-e4c1-4bf0-82e7-1fc9f870f160 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:21.710405 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-cc46f73e-e4c1-4bf0-82e7-1fc9f870f160 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504" status: 200 len: 1557 microversion: 2.1 time: 0.148480 May 13 17:36:21.710980 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 645/1272] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:36:21 2022] GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504 => generated 1557 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:36:21.726836 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7e3c77f8-4759-493d-b686-411a86c225a0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:21.727620 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7e3c77f8-4759-493d-b686-411a86c225a0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:21.733361 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7e3c77f8-4759-493d-b686-411a86c225a0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:21.733805 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7e3c77f8-4759-493d-b686-411a86c225a0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:21.734564 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7e3c77f8-4759-493d-b686-411a86c225a0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:21.734995 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7e3c77f8-4759-493d-b686-411a86c225a0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:21.813563 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7e3c77f8-4759-493d-b686-411a86c225a0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090437 May 13 17:36:21.814188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 628/1273] 10.222.0.64 () {58 vars in 1274 bytes} [Fri May 13 17:36:21 2022] GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:36:22.159363 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c0c3c7d2-98ba-4ccc-a322-7871d87259f2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:22.162202 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c0c3c7d2-98ba-4ccc-a322-7871d87259f2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:22.170342 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c0c3c7d2-98ba-4ccc-a322-7871d87259f2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:22.170806 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c0c3c7d2-98ba-4ccc-a322-7871d87259f2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:22.171622 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c0c3c7d2-98ba-4ccc-a322-7871d87259f2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:22.172067 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c0c3c7d2-98ba-4ccc-a322-7871d87259f2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:22.380728 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c0c3c7d2-98ba-4ccc-a322-7871d87259f2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:22.388546 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c0c3c7d2-98ba-4ccc-a322-7871d87259f2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:22.390044 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c0c3c7d2-98ba-4ccc-a322-7871d87259f2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:22.391253 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c0c3c7d2-98ba-4ccc-a322-7871d87259f2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1724 microversion: 2.20 time: 0.239790 May 13 17:36:22.391901 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 646/1274] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:22 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1724 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:36:22.905544 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-5ae70937-6d5e-4983-8d5a-0d7e9b5cb584 req-dd3e1cf6-a2c4-4876-8ea8-a4b15b7140fc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3946add-9fd1-4b68-815a-b2f91ff85504", "tag": "3f4c19e6-a6aa-42e2-8c1b-98a74f543196"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:36:22.913765 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-5ae70937-6d5e-4983-8d5a-0d7e9b5cb584 req-dd3e1cf6-a2c4-4876-8ea8-a4b15b7140fc service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:22.918662 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-5ae70937-6d5e-4983-8d5a-0d7e9b5cb584 req-dd3e1cf6-a2c4-4876-8ea8-a4b15b7140fc service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:22.927355 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-5ae70937-6d5e-4983-8d5a-0d7e9b5cb584 req-dd3e1cf6-a2c4-4876-8ea8-a4b15b7140fc service nova] Creating event network-changed:3f4c19e6-a6aa-42e2-8c1b-98a74f543196 for instance e3946add-9fd1-4b68-815a-b2f91ff85504 on hv-cinder-84178 May 13 17:36:22.932827 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-5ae70937-6d5e-4983-8d5a-0d7e9b5cb584 req-dd3e1cf6-a2c4-4876-8ea8-a4b15b7140fc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031254 May 13 17:36:22.933807 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 629/1275] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:36:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:36:23.410381 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a21b93fb-bf00-4ea2-85ea-9b12f5b73c16 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:23.410996 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a21b93fb-bf00-4ea2-85ea-9b12f5b73c16 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:23.417555 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a21b93fb-bf00-4ea2-85ea-9b12f5b73c16 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:23.418009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a21b93fb-bf00-4ea2-85ea-9b12f5b73c16 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:23.418829 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a21b93fb-bf00-4ea2-85ea-9b12f5b73c16 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:23.419307 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a21b93fb-bf00-4ea2-85ea-9b12f5b73c16 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:23.588817 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a21b93fb-bf00-4ea2-85ea-9b12f5b73c16 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:23.598182 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a21b93fb-bf00-4ea2-85ea-9b12f5b73c16 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:23.599872 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a21b93fb-bf00-4ea2-85ea-9b12f5b73c16 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:23.601110 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a21b93fb-bf00-4ea2-85ea-9b12f5b73c16 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1745 microversion: 2.20 time: 0.195179 May 13 17:36:23.601878 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 647/1276] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:23 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1745 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:24.622671 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-150eaef7-b89d-4e80-877b-08fba8ee6838 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:24.623494 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-150eaef7-b89d-4e80-877b-08fba8ee6838 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:24.629625 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-150eaef7-b89d-4e80-877b-08fba8ee6838 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:24.630324 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-150eaef7-b89d-4e80-877b-08fba8ee6838 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:24.631110 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-150eaef7-b89d-4e80-877b-08fba8ee6838 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:24.631576 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-150eaef7-b89d-4e80-877b-08fba8ee6838 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:24.763028 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-150eaef7-b89d-4e80-877b-08fba8ee6838 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:24.770838 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-150eaef7-b89d-4e80-877b-08fba8ee6838 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:24.772303 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-150eaef7-b89d-4e80-877b-08fba8ee6838 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:24.773473 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-150eaef7-b89d-4e80-877b-08fba8ee6838 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1745 microversion: 2.20 time: 0.155502 May 13 17:36:24.774037 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 630/1277] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:24 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:25.791977 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6e516ec0-3eaf-49ee-8711-815614f8c546 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:25.792699 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6e516ec0-3eaf-49ee-8711-815614f8c546 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:25.800304 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6e516ec0-3eaf-49ee-8711-815614f8c546 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:25.801128 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6e516ec0-3eaf-49ee-8711-815614f8c546 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:25.802068 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6e516ec0-3eaf-49ee-8711-815614f8c546 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:25.802637 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6e516ec0-3eaf-49ee-8711-815614f8c546 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:25.950008 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6e516ec0-3eaf-49ee-8711-815614f8c546 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:25.959951 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6e516ec0-3eaf-49ee-8711-815614f8c546 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:25.961457 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6e516ec0-3eaf-49ee-8711-815614f8c546 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:25.962753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6e516ec0-3eaf-49ee-8711-815614f8c546 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1745 microversion: 2.20 time: 0.175114 May 13 17:36:25.963349 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 648/1278] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:25 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1745 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:26.684538 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-d213eda6-2eef-4ae3-a5f6-2bef8f6a5c1a req-d6ccd1b0-f7f2-4f77-abb2-80e55a88092b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e3c7f8-88a0-4922-9bbe-0ebf07125a8a", "name": "network-vif-plugged", "status": "completed", "tag": "acf21395-ff17-45fa-b717-d3bb2054575b"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:36:26.692782 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-d213eda6-2eef-4ae3-a5f6-2bef8f6a5c1a req-d6ccd1b0-f7f2-4f77-abb2-80e55a88092b service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:26.693206 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-d213eda6-2eef-4ae3-a5f6-2bef8f6a5c1a req-d6ccd1b0-f7f2-4f77-abb2-80e55a88092b service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:26.704462 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-d213eda6-2eef-4ae3-a5f6-2bef8f6a5c1a req-d6ccd1b0-f7f2-4f77-abb2-80e55a88092b service nova] Creating event network-vif-plugged:acf21395-ff17-45fa-b717-d3bb2054575b for instance 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a on hv-cinder-84178 May 13 17:36:26.710067 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-d213eda6-2eef-4ae3-a5f6-2bef8f6a5c1a req-d6ccd1b0-f7f2-4f77-abb2-80e55a88092b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029560 May 13 17:36:26.710776 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 631/1279] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:36:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:36:26.984365 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1406dec5-a0ee-471a-aba0-db1d3c809d07 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:26.985098 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1406dec5-a0ee-471a-aba0-db1d3c809d07 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:26.991500 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1406dec5-a0ee-471a-aba0-db1d3c809d07 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:26.992014 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1406dec5-a0ee-471a-aba0-db1d3c809d07 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:26.992851 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1406dec5-a0ee-471a-aba0-db1d3c809d07 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:26.993227 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1406dec5-a0ee-471a-aba0-db1d3c809d07 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:27.129673 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1406dec5-a0ee-471a-aba0-db1d3c809d07 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:27.137423 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1406dec5-a0ee-471a-aba0-db1d3c809d07 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:27.138950 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1406dec5-a0ee-471a-aba0-db1d3c809d07 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:27.140168 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1406dec5-a0ee-471a-aba0-db1d3c809d07 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1745 microversion: 2.20 time: 0.159892 May 13 17:36:27.140721 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 649/1280] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:26 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:28.160012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7bac4464-8d8d-4f49-bd08-45f28504059f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:28.160721 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7bac4464-8d8d-4f49-bd08-45f28504059f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:28.166751 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7bac4464-8d8d-4f49-bd08-45f28504059f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:28.167243 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7bac4464-8d8d-4f49-bd08-45f28504059f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:28.168015 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7bac4464-8d8d-4f49-bd08-45f28504059f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:28.168456 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7bac4464-8d8d-4f49-bd08-45f28504059f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:28.309622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7bac4464-8d8d-4f49-bd08-45f28504059f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:28.318627 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7bac4464-8d8d-4f49-bd08-45f28504059f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:28.320186 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7bac4464-8d8d-4f49-bd08-45f28504059f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:28.321355 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7bac4464-8d8d-4f49-bd08-45f28504059f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1745 microversion: 2.20 time: 0.166198 May 13 17:36:28.321948 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 632/1281] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:28 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1745 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:29.340187 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d36f4eac-fadf-4b40-850c-ea43bf4e79f1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:29.341209 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d36f4eac-fadf-4b40-850c-ea43bf4e79f1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:29.350488 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d36f4eac-fadf-4b40-850c-ea43bf4e79f1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:29.351278 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d36f4eac-fadf-4b40-850c-ea43bf4e79f1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:29.352654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d36f4eac-fadf-4b40-850c-ea43bf4e79f1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:29.353388 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d36f4eac-fadf-4b40-850c-ea43bf4e79f1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:29.485148 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d36f4eac-fadf-4b40-850c-ea43bf4e79f1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:29.493232 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d36f4eac-fadf-4b40-850c-ea43bf4e79f1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:29.494706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d36f4eac-fadf-4b40-850c-ea43bf4e79f1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:29.495905 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d36f4eac-fadf-4b40-850c-ea43bf4e79f1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1745 microversion: 2.20 time: 0.160112 May 13 17:36:29.496461 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 650/1282] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:29 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1745 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:30.514624 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-73549b08-ee00-4150-8813-19f525dad058 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:30.515344 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-73549b08-ee00-4150-8813-19f525dad058 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:30.522638 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-73549b08-ee00-4150-8813-19f525dad058 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:30.523374 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-73549b08-ee00-4150-8813-19f525dad058 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:30.524685 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-73549b08-ee00-4150-8813-19f525dad058 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:30.525337 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-73549b08-ee00-4150-8813-19f525dad058 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:30.701986 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-73549b08-ee00-4150-8813-19f525dad058 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:30.712212 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-73549b08-ee00-4150-8813-19f525dad058 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:30.714222 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-73549b08-ee00-4150-8813-19f525dad058 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:30.715405 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-73549b08-ee00-4150-8813-19f525dad058 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1740 microversion: 2.20 time: 0.205433 May 13 17:36:30.723511 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 633/1283] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:30 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1740 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:31.739979 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-303d99e9-0d6f-48f4-99f5-afe56cccc231 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:31.740513 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-303d99e9-0d6f-48f4-99f5-afe56cccc231 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:31.747013 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-303d99e9-0d6f-48f4-99f5-afe56cccc231 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:31.747490 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-303d99e9-0d6f-48f4-99f5-afe56cccc231 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:31.748265 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-303d99e9-0d6f-48f4-99f5-afe56cccc231 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:31.748696 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-303d99e9-0d6f-48f4-99f5-afe56cccc231 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:31.903271 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-303d99e9-0d6f-48f4-99f5-afe56cccc231 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:31.908005 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-303d99e9-0d6f-48f4-99f5-afe56cccc231 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:31.910111 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-303d99e9-0d6f-48f4-99f5-afe56cccc231 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:31.911387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-303d99e9-0d6f-48f4-99f5-afe56cccc231 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1740 microversion: 2.20 time: 0.175631 May 13 17:36:31.911998 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 651/1284] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:31 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:32.930446 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-98c913f0-7e38-445c-bc55-da78a3fb4e5f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:32.931862 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-98c913f0-7e38-445c-bc55-da78a3fb4e5f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:32.940168 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-98c913f0-7e38-445c-bc55-da78a3fb4e5f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:32.940844 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-98c913f0-7e38-445c-bc55-da78a3fb4e5f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:32.941804 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-98c913f0-7e38-445c-bc55-da78a3fb4e5f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:32.942426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-98c913f0-7e38-445c-bc55-da78a3fb4e5f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:33.087388 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-98c913f0-7e38-445c-bc55-da78a3fb4e5f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:33.095459 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-98c913f0-7e38-445c-bc55-da78a3fb4e5f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:33.097602 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-98c913f0-7e38-445c-bc55-da78a3fb4e5f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:33.098777 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-98c913f0-7e38-445c-bc55-da78a3fb4e5f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1740 microversion: 2.20 time: 0.172505 May 13 17:36:33.099365 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 634/1285] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:32 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:34.118257 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-009b5436-7aaf-4365-a74b-3b8a392bbea3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:34.119310 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-009b5436-7aaf-4365-a74b-3b8a392bbea3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:34.126457 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-009b5436-7aaf-4365-a74b-3b8a392bbea3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:34.148358 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-009b5436-7aaf-4365-a74b-3b8a392bbea3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:34.148358 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-009b5436-7aaf-4365-a74b-3b8a392bbea3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:34.148358 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-009b5436-7aaf-4365-a74b-3b8a392bbea3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:34.263843 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-009b5436-7aaf-4365-a74b-3b8a392bbea3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:34.272597 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-009b5436-7aaf-4365-a74b-3b8a392bbea3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:34.274095 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-009b5436-7aaf-4365-a74b-3b8a392bbea3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:34.275294 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-009b5436-7aaf-4365-a74b-3b8a392bbea3 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1740 microversion: 2.20 time: 0.161904 May 13 17:36:34.275972 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 652/1286] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:34 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:35.295036 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3ef0a470-a91b-430a-9bfd-2d4e6ff0a584 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:35.295756 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3ef0a470-a91b-430a-9bfd-2d4e6ff0a584 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:35.302486 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3ef0a470-a91b-430a-9bfd-2d4e6ff0a584 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:35.302936 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3ef0a470-a91b-430a-9bfd-2d4e6ff0a584 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:35.303810 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3ef0a470-a91b-430a-9bfd-2d4e6ff0a584 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:35.304253 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3ef0a470-a91b-430a-9bfd-2d4e6ff0a584 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:35.440997 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3ef0a470-a91b-430a-9bfd-2d4e6ff0a584 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:35.449771 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3ef0a470-a91b-430a-9bfd-2d4e6ff0a584 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:35.451457 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3ef0a470-a91b-430a-9bfd-2d4e6ff0a584 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:35.452740 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3ef0a470-a91b-430a-9bfd-2d4e6ff0a584 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1740 microversion: 2.20 time: 0.161845 May 13 17:36:35.453407 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 635/1287] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:35 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:36.471545 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-239777ff-6cc7-4375-9217-0ebd84e18749 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:36.473334 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-239777ff-6cc7-4375-9217-0ebd84e18749 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:36.479934 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-239777ff-6cc7-4375-9217-0ebd84e18749 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:36.480385 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-239777ff-6cc7-4375-9217-0ebd84e18749 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:36.481155 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-239777ff-6cc7-4375-9217-0ebd84e18749 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:36.481771 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-239777ff-6cc7-4375-9217-0ebd84e18749 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:36.647997 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-239777ff-6cc7-4375-9217-0ebd84e18749 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:36.657078 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-239777ff-6cc7-4375-9217-0ebd84e18749 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:36.658951 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-239777ff-6cc7-4375-9217-0ebd84e18749 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:36.660452 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-239777ff-6cc7-4375-9217-0ebd84e18749 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1740 microversion: 2.20 time: 0.192807 May 13 17:36:36.661091 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 653/1288] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:36 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1740 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:37.680015 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-af81c7c5-2ae2-40ed-be0f-059504036e09 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:37.680849 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-af81c7c5-2ae2-40ed-be0f-059504036e09 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:37.687412 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-af81c7c5-2ae2-40ed-be0f-059504036e09 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:37.687952 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-af81c7c5-2ae2-40ed-be0f-059504036e09 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:37.689218 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-af81c7c5-2ae2-40ed-be0f-059504036e09 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:37.689742 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-af81c7c5-2ae2-40ed-be0f-059504036e09 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:37.833169 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-af81c7c5-2ae2-40ed-be0f-059504036e09 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:37.841601 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-af81c7c5-2ae2-40ed-be0f-059504036e09 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:37.843451 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-af81c7c5-2ae2-40ed-be0f-059504036e09 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:37.844629 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-af81c7c5-2ae2-40ed-be0f-059504036e09 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1740 microversion: 2.20 time: 0.169142 May 13 17:36:37.850513 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 636/1289] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:37 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:38.864524 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fcc22368-7b3c-48d1-8286-78349c87152d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:38.865312 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fcc22368-7b3c-48d1-8286-78349c87152d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:38.871200 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fcc22368-7b3c-48d1-8286-78349c87152d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:38.871654 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fcc22368-7b3c-48d1-8286-78349c87152d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:38.872430 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fcc22368-7b3c-48d1-8286-78349c87152d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:38.873221 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fcc22368-7b3c-48d1-8286-78349c87152d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:39.065831 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fcc22368-7b3c-48d1-8286-78349c87152d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:39.077240 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fcc22368-7b3c-48d1-8286-78349c87152d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:39.079686 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fcc22368-7b3c-48d1-8286-78349c87152d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:39.081286 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fcc22368-7b3c-48d1-8286-78349c87152d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1740 microversion: 2.20 time: 0.221869 May 13 17:36:39.094878 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 654/1290] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:38 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1740 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:36:40.102009 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-fcad2a61-2da4-4b51-88f3-97ec5143e59d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:40.102836 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-fcad2a61-2da4-4b51-88f3-97ec5143e59d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:40.109688 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fcad2a61-2da4-4b51-88f3-97ec5143e59d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:40.110140 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fcad2a61-2da4-4b51-88f3-97ec5143e59d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:40.110943 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fcad2a61-2da4-4b51-88f3-97ec5143e59d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:40.111412 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fcad2a61-2da4-4b51-88f3-97ec5143e59d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:40.463753 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-fcad2a61-2da4-4b51-88f3-97ec5143e59d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:40.472428 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-fcad2a61-2da4-4b51-88f3-97ec5143e59d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:40.474154 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-fcad2a61-2da4-4b51-88f3-97ec5143e59d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:40.475348 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-fcad2a61-2da4-4b51-88f3-97ec5143e59d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1740 microversion: 2.20 time: 0.378064 May 13 17:36:40.476438 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 637/1291] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:40 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1740 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:41.494502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-61ed05b0-0746-462f-bc43-5cc7ae28b197 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:41.495113 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-61ed05b0-0746-462f-bc43-5cc7ae28b197 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:41.503329 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61ed05b0-0746-462f-bc43-5cc7ae28b197 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:41.504374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61ed05b0-0746-462f-bc43-5cc7ae28b197 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:41.505391 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61ed05b0-0746-462f-bc43-5cc7ae28b197 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:41.505833 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61ed05b0-0746-462f-bc43-5cc7ae28b197 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:41.732291 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-61ed05b0-0746-462f-bc43-5cc7ae28b197 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:41.742766 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-61ed05b0-0746-462f-bc43-5cc7ae28b197 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:41.747175 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-61ed05b0-0746-462f-bc43-5cc7ae28b197 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:41.747175 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-61ed05b0-0746-462f-bc43-5cc7ae28b197 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1740 microversion: 2.20 time: 0.255458 May 13 17:36:41.747175 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 655/1292] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:41 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1740 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:42.765905 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-fa3639bb-e239-4ddc-85f6-6d29ca64b42c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:42.767473 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-fa3639bb-e239-4ddc-85f6-6d29ca64b42c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:42.777217 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fa3639bb-e239-4ddc-85f6-6d29ca64b42c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:42.778174 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fa3639bb-e239-4ddc-85f6-6d29ca64b42c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:42.779521 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fa3639bb-e239-4ddc-85f6-6d29ca64b42c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:42.780257 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fa3639bb-e239-4ddc-85f6-6d29ca64b42c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:42.942047 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-fa3639bb-e239-4ddc-85f6-6d29ca64b42c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:42.950833 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-fa3639bb-e239-4ddc-85f6-6d29ca64b42c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:42.952357 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-fa3639bb-e239-4ddc-85f6-6d29ca64b42c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:42.953888 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-fa3639bb-e239-4ddc-85f6-6d29ca64b42c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1740 microversion: 2.20 time: 0.192090 May 13 17:36:42.965278 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 638/1293] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:42 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:43.972318 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1ed3519f-2676-46d7-a879-ba55978d7771 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:43.972935 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1ed3519f-2676-46d7-a879-ba55978d7771 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:43.980276 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1ed3519f-2676-46d7-a879-ba55978d7771 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:43.980671 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1ed3519f-2676-46d7-a879-ba55978d7771 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:43.981446 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1ed3519f-2676-46d7-a879-ba55978d7771 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:43.981883 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1ed3519f-2676-46d7-a879-ba55978d7771 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:44.115681 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1ed3519f-2676-46d7-a879-ba55978d7771 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:44.125479 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1ed3519f-2676-46d7-a879-ba55978d7771 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:44.127007 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1ed3519f-2676-46d7-a879-ba55978d7771 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:44.128395 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1ed3519f-2676-46d7-a879-ba55978d7771 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1740 microversion: 2.20 time: 0.160015 May 13 17:36:44.129172 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 656/1294] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:43 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:45.155815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d3bdeec6-466c-4c26-93b0-c218cd71e115 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:45.157681 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d3bdeec6-466c-4c26-93b0-c218cd71e115 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:45.163550 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d3bdeec6-466c-4c26-93b0-c218cd71e115 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:45.164001 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d3bdeec6-466c-4c26-93b0-c218cd71e115 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:45.164789 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d3bdeec6-466c-4c26-93b0-c218cd71e115 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:45.165231 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d3bdeec6-466c-4c26-93b0-c218cd71e115 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:45.330491 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d3bdeec6-466c-4c26-93b0-c218cd71e115 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:45.338976 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d3bdeec6-466c-4c26-93b0-c218cd71e115 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:45.340616 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d3bdeec6-466c-4c26-93b0-c218cd71e115 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:45.341788 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d3bdeec6-466c-4c26-93b0-c218cd71e115 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1722 microversion: 2.20 time: 0.189829 May 13 17:36:45.342349 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 639/1295] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:45 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:46.360020 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4dcac0b8-10d6-456d-b5ae-e14d2a1a1203 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:46.360668 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4dcac0b8-10d6-456d-b5ae-e14d2a1a1203 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:46.367516 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4dcac0b8-10d6-456d-b5ae-e14d2a1a1203 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:46.367975 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4dcac0b8-10d6-456d-b5ae-e14d2a1a1203 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:46.368748 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4dcac0b8-10d6-456d-b5ae-e14d2a1a1203 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:46.369189 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4dcac0b8-10d6-456d-b5ae-e14d2a1a1203 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:46.506265 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4dcac0b8-10d6-456d-b5ae-e14d2a1a1203 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:46.514054 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4dcac0b8-10d6-456d-b5ae-e14d2a1a1203 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:46.515592 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4dcac0b8-10d6-456d-b5ae-e14d2a1a1203 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:46.516758 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4dcac0b8-10d6-456d-b5ae-e14d2a1a1203 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1722 microversion: 2.20 time: 0.160575 May 13 17:36:46.517312 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 657/1296] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:46 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:46.754013 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-0cee6145-ede2-4d9e-b0b9-c66f7f26b786 req-fc276260-1c69-451e-b5ae-e052783b73cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e3c7f8-88a0-4922-9bbe-0ebf07125a8a", "name": "network-vif-unplugged", "status": "completed", "tag": "acf21395-ff17-45fa-b717-d3bb2054575b"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:36:46.769389 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-0cee6145-ede2-4d9e-b0b9-c66f7f26b786 req-fc276260-1c69-451e-b5ae-e052783b73cb service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:46.769389 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-0cee6145-ede2-4d9e-b0b9-c66f7f26b786 req-fc276260-1c69-451e-b5ae-e052783b73cb service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:46.777774 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-0cee6145-ede2-4d9e-b0b9-c66f7f26b786 req-fc276260-1c69-451e-b5ae-e052783b73cb service nova] Creating event network-vif-unplugged:acf21395-ff17-45fa-b717-d3bb2054575b for instance 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a on hv-cinder-84178 May 13 17:36:46.783072 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-0cee6145-ede2-4d9e-b0b9-c66f7f26b786 req-fc276260-1c69-451e-b5ae-e052783b73cb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033576 May 13 17:36:46.783716 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 640/1297] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:36:46 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:36:47.534340 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b2390d8d-b4ea-4b85-a025-09ac0f18679b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:47.535585 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b2390d8d-b4ea-4b85-a025-09ac0f18679b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:47.542140 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b2390d8d-b4ea-4b85-a025-09ac0f18679b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:47.542974 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b2390d8d-b4ea-4b85-a025-09ac0f18679b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:47.543785 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b2390d8d-b4ea-4b85-a025-09ac0f18679b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:47.544390 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b2390d8d-b4ea-4b85-a025-09ac0f18679b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:47.679845 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b2390d8d-b4ea-4b85-a025-09ac0f18679b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:47.687597 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b2390d8d-b4ea-4b85-a025-09ac0f18679b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:47.692148 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b2390d8d-b4ea-4b85-a025-09ac0f18679b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:47.692148 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b2390d8d-b4ea-4b85-a025-09ac0f18679b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1722 microversion: 2.20 time: 0.160039 May 13 17:36:47.692148 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 658/1298] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:47 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:48.709706 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-8ebc7444-eb62-4775-9d62-26a86b56722d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:48.710406 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-8ebc7444-eb62-4775-9d62-26a86b56722d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:48.716594 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8ebc7444-eb62-4775-9d62-26a86b56722d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:48.717043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8ebc7444-eb62-4775-9d62-26a86b56722d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:48.717810 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8ebc7444-eb62-4775-9d62-26a86b56722d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:48.718256 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8ebc7444-eb62-4775-9d62-26a86b56722d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:48.853405 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-8ebc7444-eb62-4775-9d62-26a86b56722d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:48.861127 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-8ebc7444-eb62-4775-9d62-26a86b56722d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:48.862613 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-8ebc7444-eb62-4775-9d62-26a86b56722d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:48.863803 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-8ebc7444-eb62-4775-9d62-26a86b56722d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1665 microversion: 2.20 time: 0.158965 May 13 17:36:48.864369 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 641/1299] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:48 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1665 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:36:48.881882 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-754e28fc-4301-477d-9b65-7a4090e99982 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "58e90817-25a2-41db-befb-0c5bb0e3fa4d"}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:36:48.882932 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-754e28fc-4301-477d-9b65-7a4090e99982 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:48.889252 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-754e28fc-4301-477d-9b65-7a4090e99982 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:48.889703 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-754e28fc-4301-477d-9b65-7a4090e99982 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:48.890478 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-754e28fc-4301-477d-9b65-7a4090e99982 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:48.890913 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-754e28fc-4301-477d-9b65-7a4090e99982 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:49.748063 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-754e28fc-4301-477d-9b65-7a4090e99982 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "POST /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.869976 May 13 17:36:49.748636 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 659/1300] 10.222.0.64 () {62 vars in 1363 bytes} [Fri May 13 17:36:48 2022] POST /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a/os-volume_attachments => generated 188 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 13 17:36:49.858642 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-232b3d73-cc72-43c1-8d25-13f080514094 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:49.859162 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-232b3d73-cc72-43c1-8d25-13f080514094 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:49.865940 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-232b3d73-cc72-43c1-8d25-13f080514094 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:49.866400 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-232b3d73-cc72-43c1-8d25-13f080514094 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:49.867241 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-232b3d73-cc72-43c1-8d25-13f080514094 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:49.867685 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-232b3d73-cc72-43c1-8d25-13f080514094 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:50.519008 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-232b3d73-cc72-43c1-8d25-13f080514094 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "DELETE /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a/os-volume_attachments/58e90817-25a2-41db-befb-0c5bb0e3fa4d" status: 202 len: 0 microversion: 2.20 time: 0.664607 May 13 17:36:50.519642 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 642/1301] 10.222.0.64 () {60 vars in 1456 bytes} [Fri May 13 17:36:49 2022] DELETE /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a/os-volume_attachments/58e90817-25a2-41db-befb-0c5bb0e3fa4d => generated 0 bytes in 666 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 17:36:50.574592 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-df1f076c-e4aa-48b5-94dd-433bea38486b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:36:50.575732 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-df1f076c-e4aa-48b5-94dd-433bea38486b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:50.583749 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-df1f076c-e4aa-48b5-94dd-433bea38486b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:50.584202 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-df1f076c-e4aa-48b5-94dd-433bea38486b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:50.585021 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-df1f076c-e4aa-48b5-94dd-433bea38486b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:50.585463 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-df1f076c-e4aa-48b5-94dd-433bea38486b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:50.729269 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-df1f076c-e4aa-48b5-94dd-433bea38486b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "POST /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a/action" status: 202 len: 0 microversion: 2.20 time: 0.158566 May 13 17:36:50.729966 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 660/1302] 10.222.0.64 () {62 vars in 1318 bytes} [Fri May 13 17:36:50 2022] POST /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 13 17:36:50.738081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-c274b4e9-ffbc-40d2-bf97-4d6b9e11fc8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:50.739330 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-c274b4e9-ffbc-40d2-bf97-4d6b9e11fc8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:50.746848 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c274b4e9-ffbc-40d2-bf97-4d6b9e11fc8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:50.747332 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c274b4e9-ffbc-40d2-bf97-4d6b9e11fc8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:50.748113 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c274b4e9-ffbc-40d2-bf97-4d6b9e11fc8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:50.748548 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c274b4e9-ffbc-40d2-bf97-4d6b9e11fc8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:50.876917 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c274b4e9-ffbc-40d2-bf97-4d6b9e11fc8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:50.888286 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c274b4e9-ffbc-40d2-bf97-4d6b9e11fc8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:50.889996 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c274b4e9-ffbc-40d2-bf97-4d6b9e11fc8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:50.891380 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-c274b4e9-ffbc-40d2-bf97-4d6b9e11fc8d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1673 microversion: 2.20 time: 0.157275 May 13 17:36:50.891950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 643/1303] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:50 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:36:51.914451 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-03e68fe9-ef75-45e4-b3af-c0ddf58125a9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:51.915228 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-03e68fe9-ef75-45e4-b3af-c0ddf58125a9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:51.922300 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-03e68fe9-ef75-45e4-b3af-c0ddf58125a9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:51.922791 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-03e68fe9-ef75-45e4-b3af-c0ddf58125a9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:51.923589 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-03e68fe9-ef75-45e4-b3af-c0ddf58125a9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:51.924031 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-03e68fe9-ef75-45e4-b3af-c0ddf58125a9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:52.013539 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-14ab3ae7-adf1-42d5-b3a5-c55c300b6bd6 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:52.014686 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-14ab3ae7-adf1-42d5-b3a5-c55c300b6bd6 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:52.021925 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-14ab3ae7-adf1-42d5-b3a5-c55c300b6bd6 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:52.022382 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-14ab3ae7-adf1-42d5-b3a5-c55c300b6bd6 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:52.023390 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-14ab3ae7-adf1-42d5-b3a5-c55c300b6bd6 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:52.023837 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-14ab3ae7-adf1-42d5-b3a5-c55c300b6bd6 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:52.052344 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-14ab3ae7-adf1-42d5-b3a5-c55c300b6bd6 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e/ips" status: 200 len: 146 microversion: 2.1 time: 0.042694 May 13 17:36:52.053597 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 644/1304] 10.222.0.64 () {58 vars in 1247 bytes} [Fri May 13 17:36:52 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e/ips => generated 146 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:36:52.067810 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-03e68fe9-ef75-45e4-b3af-c0ddf58125a9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:52.076540 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-03e68fe9-ef75-45e4-b3af-c0ddf58125a9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:52.078191 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-03e68fe9-ef75-45e4-b3af-c0ddf58125a9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:52.079672 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-03e68fe9-ef75-45e4-b3af-c0ddf58125a9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1673 microversion: 2.20 time: 0.170669 May 13 17:36:52.080587 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 661/1305] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:51 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1673 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:52.944165 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-4fcb9ccb-a8c0-45a2-98ce-a19ef68a06d1 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:52.944945 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-4fcb9ccb-a8c0-45a2-98ce-a19ef68a06d1 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:52.951468 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4fcb9ccb-a8c0-45a2-98ce-a19ef68a06d1 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:52.951990 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4fcb9ccb-a8c0-45a2-98ce-a19ef68a06d1 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:52.953063 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4fcb9ccb-a8c0-45a2-98ce-a19ef68a06d1 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:52.953621 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4fcb9ccb-a8c0-45a2-98ce-a19ef68a06d1 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:52.954309 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-26a403af-e0c4-4639-9cf9-3ae5a04c7a38 req-c9239661-2bfb-475f-99f3-72086ca85868 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a310844-e208-4f17-a8c9-fd4db4acf00d", "tag": "f37d13dd-347a-41e2-8ca5-2b0f1df46c9c"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:36:52.969368 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-26a403af-e0c4-4639-9cf9-3ae5a04c7a38 req-c9239661-2bfb-475f-99f3-72086ca85868 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:52.969818 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-26a403af-e0c4-4639-9cf9-3ae5a04c7a38 req-c9239661-2bfb-475f-99f3-72086ca85868 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:52.985678 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-4fcb9ccb-a8c0-45a2-98ce-a19ef68a06d1 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Going to try to terminate instance {{(pid=117492) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 17:36:52.986717 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-26a403af-e0c4-4639-9cf9-3ae5a04c7a38 req-c9239661-2bfb-475f-99f3-72086ca85868 service nova] Creating event network-changed:f37d13dd-347a-41e2-8ca5-2b0f1df46c9c for instance 7a310844-e208-4f17-a8c9-fd4db4acf00d on hv-cinder-84178 May 13 17:36:53.011624 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-26a403af-e0c4-4639-9cf9-3ae5a04c7a38 req-c9239661-2bfb-475f-99f3-72086ca85868 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051203 May 13 17:36:53.011624 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 662/1306] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:36:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:36:53.103707 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-82c2e93a-cbfa-4485-894b-7834f38257e8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:53.104492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-82c2e93a-cbfa-4485-894b-7834f38257e8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:53.111165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-82c2e93a-cbfa-4485-894b-7834f38257e8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:53.112020 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-82c2e93a-cbfa-4485-894b-7834f38257e8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:53.113352 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-82c2e93a-cbfa-4485-894b-7834f38257e8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:53.114569 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-82c2e93a-cbfa-4485-894b-7834f38257e8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:53.286785 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-4fcb9ccb-a8c0-45a2-98ce-a19ef68a06d1 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "DELETE /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 204 len: 0 microversion: 2.1 time: 0.346357 May 13 17:36:53.290966 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 645/1307] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:36:52 2022] DELETE /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 0 bytes in 349 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 17:36:53.296964 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-5159d066-fdca-402b-8bad-53fbf067b270 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:53.297668 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-5159d066-fdca-402b-8bad-53fbf067b270 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:53.305995 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5159d066-fdca-402b-8bad-53fbf067b270 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:53.306712 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5159d066-fdca-402b-8bad-53fbf067b270 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:53.307703 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5159d066-fdca-402b-8bad-53fbf067b270 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:53.308149 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5159d066-fdca-402b-8bad-53fbf067b270 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:53.375390 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-82c2e93a-cbfa-4485-894b-7834f38257e8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:53.383567 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-82c2e93a-cbfa-4485-894b-7834f38257e8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:53.385298 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-82c2e93a-cbfa-4485-894b-7834f38257e8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:53.386669 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-82c2e93a-cbfa-4485-894b-7834f38257e8 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.288512 May 13 17:36:53.387819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 663/1308] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:53 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:36:53.452221 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-5159d066-fdca-402b-8bad-53fbf067b270 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:53.460088 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-5159d066-fdca-402b-8bad-53fbf067b270 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1567 microversion: 2.1 time: 0.167517 May 13 17:36:53.460653 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 646/1309] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:36:53 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:36:54.409739 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5940df2a-57dd-40c7-bf10-9cac3bf453c9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:54.410347 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5940df2a-57dd-40c7-bf10-9cac3bf453c9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:54.416645 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5940df2a-57dd-40c7-bf10-9cac3bf453c9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:54.417101 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5940df2a-57dd-40c7-bf10-9cac3bf453c9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:54.417908 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5940df2a-57dd-40c7-bf10-9cac3bf453c9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:54.418345 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5940df2a-57dd-40c7-bf10-9cac3bf453c9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:54.478168 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7b6a5c0c-9411-44e2-8a75-0b4a5a9c0d5a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:54.478818 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7b6a5c0c-9411-44e2-8a75-0b4a5a9c0d5a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:54.485086 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7b6a5c0c-9411-44e2-8a75-0b4a5a9c0d5a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:54.485530 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7b6a5c0c-9411-44e2-8a75-0b4a5a9c0d5a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:54.486289 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7b6a5c0c-9411-44e2-8a75-0b4a5a9c0d5a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:54.486726 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7b6a5c0c-9411-44e2-8a75-0b4a5a9c0d5a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:54.548215 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5940df2a-57dd-40c7-bf10-9cac3bf453c9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:54.556557 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5940df2a-57dd-40c7-bf10-9cac3bf453c9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:54.558050 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5940df2a-57dd-40c7-bf10-9cac3bf453c9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:54.559240 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5940df2a-57dd-40c7-bf10-9cac3bf453c9 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.153457 May 13 17:36:54.559804 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 664/1310] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:54 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:54.622745 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7b6a5c0c-9411-44e2-8a75-0b4a5a9c0d5a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:54.630351 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7b6a5c0c-9411-44e2-8a75-0b4a5a9c0d5a tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1567 microversion: 2.1 time: 0.156812 May 13 17:36:54.630927 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 647/1311] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:36:54 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:36:54.756348 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-96c400d3-f23b-4d37-9dcc-ba787671ef74 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ee980cf4-10a5-4036-8610-85546f4515ed"}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:36:54.757534 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-96c400d3-f23b-4d37-9dcc-ba787671ef74 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:54.763499 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-96c400d3-f23b-4d37-9dcc-ba787671ef74 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:54.763955 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-96c400d3-f23b-4d37-9dcc-ba787671ef74 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:54.764734 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-96c400d3-f23b-4d37-9dcc-ba787671ef74 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:54.765168 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-96c400d3-f23b-4d37-9dcc-ba787671ef74 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:55.579895 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-9bf2e16a-9441-45b6-ade2-3760e0777f77 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:55.583909 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-9bf2e16a-9441-45b6-ade2-3760e0777f77 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:55.590185 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9bf2e16a-9441-45b6-ade2-3760e0777f77 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:55.591000 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9bf2e16a-9441-45b6-ade2-3760e0777f77 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:55.594328 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9bf2e16a-9441-45b6-ade2-3760e0777f77 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:55.594798 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9bf2e16a-9441-45b6-ade2-3760e0777f77 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:56.092640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-9bf2e16a-9441-45b6-ade2-3760e0777f77 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:56.104754 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-9bf2e16a-9441-45b6-ade2-3760e0777f77 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:56.106609 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-9bf2e16a-9441-45b6-ade2-3760e0777f77 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:56.108213 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-9bf2e16a-9441-45b6-ade2-3760e0777f77 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.534566 May 13 17:36:56.119913 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 648/1312] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:55 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:56.124830 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-ea9a7a11-2ec6-43c6-a54c-0ed5b54ed39c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:56.128587 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-ea9a7a11-2ec6-43c6-a54c-0ed5b54ed39c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:56.132153 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ea9a7a11-2ec6-43c6-a54c-0ed5b54ed39c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:56.132974 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ea9a7a11-2ec6-43c6-a54c-0ed5b54ed39c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:56.134133 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ea9a7a11-2ec6-43c6-a54c-0ed5b54ed39c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:56.134753 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ea9a7a11-2ec6-43c6-a54c-0ed5b54ed39c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:56.175717 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-96c400d3-f23b-4d37-9dcc-ba787671ef74 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "POST /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.422877 May 13 17:36:56.177619 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 665/1313] 10.222.0.64 () {60 vars in 1322 bytes} [Fri May 13 17:36:54 2022] POST /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e/os-volume_attachments => generated 194 bytes in 1426 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:36:56.446791 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-ea9a7a11-2ec6-43c6-a54c-0ed5b54ed39c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:56.459734 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-ea9a7a11-2ec6-43c6-a54c-0ed5b54ed39c tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1448 microversion: 2.1 time: 0.334380 May 13 17:36:56.460422 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 649/1314] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:36:56 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1448 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:36:56.691990 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-68d812e3-0cf7-4fb4-9891-26bf3b705c25 req-c5eced4a-ef37-4c4b-aeff-1ed589c14c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a310844-e208-4f17-a8c9-fd4db4acf00d", "name": "network-vif-deleted", "tag": "f37d13dd-347a-41e2-8ca5-2b0f1df46c9c"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:36:56.707437 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-68d812e3-0cf7-4fb4-9891-26bf3b705c25 req-c5eced4a-ef37-4c4b-aeff-1ed589c14c55 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:56.708765 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-68d812e3-0cf7-4fb4-9891-26bf3b705c25 req-c5eced4a-ef37-4c4b-aeff-1ed589c14c55 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:56.721323 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-68d812e3-0cf7-4fb4-9891-26bf3b705c25 req-c5eced4a-ef37-4c4b-aeff-1ed589c14c55 service nova] Creating event network-vif-deleted:f37d13dd-347a-41e2-8ca5-2b0f1df46c9c for instance 7a310844-e208-4f17-a8c9-fd4db4acf00d on hv-cinder-84178 May 13 17:36:56.727171 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-68d812e3-0cf7-4fb4-9891-26bf3b705c25 req-c5eced4a-ef37-4c4b-aeff-1ed589c14c55 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040228 May 13 17:36:56.728419 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 666/1315] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:36:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:36:57.127242 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-4443b271-09e5-40f4-826c-5dc405032613 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:57.127794 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-4443b271-09e5-40f4-826c-5dc405032613 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:57.134901 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4443b271-09e5-40f4-826c-5dc405032613 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:57.135385 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4443b271-09e5-40f4-826c-5dc405032613 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:57.136155 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4443b271-09e5-40f4-826c-5dc405032613 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:57.136612 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4443b271-09e5-40f4-826c-5dc405032613 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:57.272352 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-4443b271-09e5-40f4-826c-5dc405032613 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:57.283007 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-4443b271-09e5-40f4-826c-5dc405032613 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:57.285553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-4443b271-09e5-40f4-826c-5dc405032613 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:57.287458 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-4443b271-09e5-40f4-826c-5dc405032613 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.164237 May 13 17:36:57.288197 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 650/1316] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:57 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:57.479298 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4c65714f-6c36-4e56-a9cf-e57bfa805dc6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:57.480624 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4c65714f-6c36-4e56-a9cf-e57bfa805dc6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:57.487643 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4c65714f-6c36-4e56-a9cf-e57bfa805dc6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:57.488343 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4c65714f-6c36-4e56-a9cf-e57bfa805dc6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:57.489338 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4c65714f-6c36-4e56-a9cf-e57bfa805dc6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:57.489941 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4c65714f-6c36-4e56-a9cf-e57bfa805dc6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:57.554371 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4c65714f-6c36-4e56-a9cf-e57bfa805dc6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:57.561977 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4c65714f-6c36-4e56-a9cf-e57bfa805dc6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1381 microversion: 2.1 time: 0.087160 May 13 17:36:57.562837 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 667/1317] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:36:57 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1381 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:36:58.305969 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-890b3f7b-af2b-493b-a020-2a297dcfd060 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:58.307029 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-890b3f7b-af2b-493b-a020-2a297dcfd060 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:58.313428 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-890b3f7b-af2b-493b-a020-2a297dcfd060 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:58.313906 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-890b3f7b-af2b-493b-a020-2a297dcfd060 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:58.314674 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-890b3f7b-af2b-493b-a020-2a297dcfd060 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:58.315118 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-890b3f7b-af2b-493b-a020-2a297dcfd060 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:58.461040 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-890b3f7b-af2b-493b-a020-2a297dcfd060 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:58.469141 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-890b3f7b-af2b-493b-a020-2a297dcfd060 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:58.470639 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-890b3f7b-af2b-493b-a020-2a297dcfd060 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:58.471950 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-890b3f7b-af2b-493b-a020-2a297dcfd060 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.170026 May 13 17:36:58.472624 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 651/1318] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:58 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:58.580448 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3878b1a9-7caf-435e-a70d-0b1f059466f1 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:58.580991 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3878b1a9-7caf-435e-a70d-0b1f059466f1 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:58.588191 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3878b1a9-7caf-435e-a70d-0b1f059466f1 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:58.588645 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3878b1a9-7caf-435e-a70d-0b1f059466f1 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:58.589431 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3878b1a9-7caf-435e-a70d-0b1f059466f1 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:58.589873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3878b1a9-7caf-435e-a70d-0b1f059466f1 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:58.652591 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3878b1a9-7caf-435e-a70d-0b1f059466f1 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:58.660571 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3878b1a9-7caf-435e-a70d-0b1f059466f1 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1381 microversion: 2.1 time: 0.084457 May 13 17:36:58.661806 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 668/1319] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:36:58 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1381 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:36:59.493413 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-8337d87b-a9d1-43b2-8be1-956690ec3cdd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:59.494758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-8337d87b-a9d1-43b2-8be1-956690ec3cdd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:59.501911 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8337d87b-a9d1-43b2-8be1-956690ec3cdd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:59.502710 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8337d87b-a9d1-43b2-8be1-956690ec3cdd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:59.503675 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8337d87b-a9d1-43b2-8be1-956690ec3cdd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:59.504278 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8337d87b-a9d1-43b2-8be1-956690ec3cdd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:59.648943 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-8337d87b-a9d1-43b2-8be1-956690ec3cdd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:59.658093 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-8337d87b-a9d1-43b2-8be1-956690ec3cdd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:59.659619 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-8337d87b-a9d1-43b2-8be1-956690ec3cdd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:59.660805 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-8337d87b-a9d1-43b2-8be1-956690ec3cdd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.172181 May 13 17:36:59.661365 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 652/1320] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:36:59 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:36:59.678690 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-649bfd68-7f1a-433e-957c-5eae769065a2 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:36:59.679911 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-649bfd68-7f1a-433e-957c-5eae769065a2 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:36:59.686511 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-649bfd68-7f1a-433e-957c-5eae769065a2 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:59.686969 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-649bfd68-7f1a-433e-957c-5eae769065a2 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:59.687910 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-649bfd68-7f1a-433e-957c-5eae769065a2 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:36:59.688353 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-649bfd68-7f1a-433e-957c-5eae769065a2 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:36:59.751110 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-649bfd68-7f1a-433e-957c-5eae769065a2 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:36:59.758352 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-649bfd68-7f1a-433e-957c-5eae769065a2 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1381 microversion: 2.1 time: 0.084384 May 13 17:36:59.758920 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 669/1321] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:36:59 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1381 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:37:00.679990 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-549faa51-79e9-4077-a2dc-faa56aecb120 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:00.680761 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-549faa51-79e9-4077-a2dc-faa56aecb120 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:00.686917 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-549faa51-79e9-4077-a2dc-faa56aecb120 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:00.693898 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-549faa51-79e9-4077-a2dc-faa56aecb120 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:00.693898 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-549faa51-79e9-4077-a2dc-faa56aecb120 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:00.693898 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-549faa51-79e9-4077-a2dc-faa56aecb120 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:00.775392 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f2e519d5-8707-4210-8e9c-801c8f464897 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:00.776081 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f2e519d5-8707-4210-8e9c-801c8f464897 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:00.782494 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f2e519d5-8707-4210-8e9c-801c8f464897 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:00.782942 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f2e519d5-8707-4210-8e9c-801c8f464897 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:00.783750 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f2e519d5-8707-4210-8e9c-801c8f464897 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:00.784190 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f2e519d5-8707-4210-8e9c-801c8f464897 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:00.852237 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f2e519d5-8707-4210-8e9c-801c8f464897 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:00.856769 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-549faa51-79e9-4077-a2dc-faa56aecb120 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:00.861327 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f2e519d5-8707-4210-8e9c-801c8f464897 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1381 microversion: 2.1 time: 0.090006 May 13 17:37:00.865268 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-549faa51-79e9-4077-a2dc-faa56aecb120 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:00.867754 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-549faa51-79e9-4077-a2dc-faa56aecb120 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:00.869361 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-549faa51-79e9-4077-a2dc-faa56aecb120 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.194696 May 13 17:37:00.871348 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 670/1322] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:00 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1381 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:37:00.879190 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 653/1323] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:37:00 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:37:01.878123 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6197ba23-1938-4f46-8099-9d608782115e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:01.878736 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6197ba23-1938-4f46-8099-9d608782115e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:01.887410 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-18ae1526-bd52-4943-8ff5-9d501823dd83 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:01.888116 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-18ae1526-bd52-4943-8ff5-9d501823dd83 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:01.889133 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6197ba23-1938-4f46-8099-9d608782115e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:01.889596 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6197ba23-1938-4f46-8099-9d608782115e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:01.890455 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6197ba23-1938-4f46-8099-9d608782115e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:01.891077 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6197ba23-1938-4f46-8099-9d608782115e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:01.899470 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-18ae1526-bd52-4943-8ff5-9d501823dd83 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:01.899921 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-18ae1526-bd52-4943-8ff5-9d501823dd83 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:01.900691 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-18ae1526-bd52-4943-8ff5-9d501823dd83 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:01.901293 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-18ae1526-bd52-4943-8ff5-9d501823dd83 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:01.958643 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6197ba23-1938-4f46-8099-9d608782115e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:01.966682 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6197ba23-1938-4f46-8099-9d608782115e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1381 microversion: 2.1 time: 0.092505 May 13 17:37:01.967284 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 671/1324] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:01 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1381 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:37:02.048460 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-18ae1526-bd52-4943-8ff5-9d501823dd83 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:02.056730 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-18ae1526-bd52-4943-8ff5-9d501823dd83 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:02.058341 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-18ae1526-bd52-4943-8ff5-9d501823dd83 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:02.059566 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-18ae1526-bd52-4943-8ff5-9d501823dd83 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.176547 May 13 17:37:02.060129 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 654/1325] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:37:01 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:37:02.984481 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9a80feb5-5c9f-4d5a-adf3-c0b3eb7b2069 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:02.985090 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9a80feb5-5c9f-4d5a-adf3-c0b3eb7b2069 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:02.996921 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a80feb5-5c9f-4d5a-adf3-c0b3eb7b2069 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:02.997384 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a80feb5-5c9f-4d5a-adf3-c0b3eb7b2069 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:02.998169 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a80feb5-5c9f-4d5a-adf3-c0b3eb7b2069 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:02.998664 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a80feb5-5c9f-4d5a-adf3-c0b3eb7b2069 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:03.062661 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-9a80feb5-5c9f-4d5a-adf3-c0b3eb7b2069 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:03.072896 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9a80feb5-5c9f-4d5a-adf3-c0b3eb7b2069 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1381 microversion: 2.1 time: 0.090948 May 13 17:37:03.074102 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 672/1326] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:02 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1381 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:37:03.077628 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-62bb592e-6038-42c8-8f1d-857621d39deb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:03.078314 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-62bb592e-6038-42c8-8f1d-857621d39deb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:03.086132 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-62bb592e-6038-42c8-8f1d-857621d39deb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:03.086686 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-62bb592e-6038-42c8-8f1d-857621d39deb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:03.087514 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-62bb592e-6038-42c8-8f1d-857621d39deb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:03.088143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-62bb592e-6038-42c8-8f1d-857621d39deb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:03.225978 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-62bb592e-6038-42c8-8f1d-857621d39deb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:03.247887 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-62bb592e-6038-42c8-8f1d-857621d39deb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:03.249441 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-62bb592e-6038-42c8-8f1d-857621d39deb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:03.250635 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-62bb592e-6038-42c8-8f1d-857621d39deb tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.176796 May 13 17:37:03.251245 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 655/1327] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:37:03 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:37:04.090808 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f208b768-401e-401c-9343-3e315a2c5bb7 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:04.092521 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f208b768-401e-401c-9343-3e315a2c5bb7 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:04.101113 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f208b768-401e-401c-9343-3e315a2c5bb7 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:04.101651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f208b768-401e-401c-9343-3e315a2c5bb7 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:04.102476 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f208b768-401e-401c-9343-3e315a2c5bb7 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:04.103204 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f208b768-401e-401c-9343-3e315a2c5bb7 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:04.173575 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f208b768-401e-401c-9343-3e315a2c5bb7 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:04.181460 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f208b768-401e-401c-9343-3e315a2c5bb7 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1381 microversion: 2.1 time: 0.095280 May 13 17:37:04.191204 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 673/1328] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:04 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1381 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:37:04.268124 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-25499a84-92ae-45f7-af2a-19c33ed807b2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:04.269565 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-25499a84-92ae-45f7-af2a-19c33ed807b2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:04.277668 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-25499a84-92ae-45f7-af2a-19c33ed807b2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:04.278508 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-25499a84-92ae-45f7-af2a-19c33ed807b2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:04.279848 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-25499a84-92ae-45f7-af2a-19c33ed807b2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:04.280530 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-25499a84-92ae-45f7-af2a-19c33ed807b2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:04.429243 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-25499a84-92ae-45f7-af2a-19c33ed807b2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:04.437037 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-25499a84-92ae-45f7-af2a-19c33ed807b2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:04.438526 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-25499a84-92ae-45f7-af2a-19c33ed807b2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:04.439725 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-25499a84-92ae-45f7-af2a-19c33ed807b2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.175454 May 13 17:37:04.440286 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 656/1329] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:37:04 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:37:05.198714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-59b55a4d-84c7-4c95-9549-06e34549f325 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:05.200260 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-59b55a4d-84c7-4c95-9549-06e34549f325 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:05.208429 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-59b55a4d-84c7-4c95-9549-06e34549f325 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:05.208954 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-59b55a4d-84c7-4c95-9549-06e34549f325 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:05.209820 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-59b55a4d-84c7-4c95-9549-06e34549f325 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:05.210330 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-59b55a4d-84c7-4c95-9549-06e34549f325 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:05.272781 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-59b55a4d-84c7-4c95-9549-06e34549f325 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:05.280429 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-59b55a4d-84c7-4c95-9549-06e34549f325 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1381 microversion: 2.1 time: 0.086414 May 13 17:37:05.291863 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 674/1330] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:05 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1381 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:37:05.459334 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-e1111dc1-9c26-4a39-ba6a-ac55b8152556 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:05.460092 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-e1111dc1-9c26-4a39-ba6a-ac55b8152556 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:05.466787 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e1111dc1-9c26-4a39-ba6a-ac55b8152556 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:05.467276 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e1111dc1-9c26-4a39-ba6a-ac55b8152556 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:05.468053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e1111dc1-9c26-4a39-ba6a-ac55b8152556 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:05.468491 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-e1111dc1-9c26-4a39-ba6a-ac55b8152556 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:05.612433 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-e1111dc1-9c26-4a39-ba6a-ac55b8152556 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:05.620933 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-e1111dc1-9c26-4a39-ba6a-ac55b8152556 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:05.622472 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-e1111dc1-9c26-4a39-ba6a-ac55b8152556 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:05.623779 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-e1111dc1-9c26-4a39-ba6a-ac55b8152556 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.169222 May 13 17:37:05.624346 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 657/1331] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:37:05 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:37:06.308385 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f4e996f8-e7eb-42a5-8f16-47840cf23226 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:06.309099 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f4e996f8-e7eb-42a5-8f16-47840cf23226 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:06.315712 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f4e996f8-e7eb-42a5-8f16-47840cf23226 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:06.316170 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f4e996f8-e7eb-42a5-8f16-47840cf23226 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:06.316951 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f4e996f8-e7eb-42a5-8f16-47840cf23226 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:06.317389 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f4e996f8-e7eb-42a5-8f16-47840cf23226 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:06.385660 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f4e996f8-e7eb-42a5-8f16-47840cf23226 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:06.393613 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f4e996f8-e7eb-42a5-8f16-47840cf23226 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1381 microversion: 2.1 time: 0.089448 May 13 17:37:06.394539 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 675/1332] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:06 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1381 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:37:06.642173 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6765560c-ba0e-42c8-b9cf-3f6144088f88 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:06.642822 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6765560c-ba0e-42c8-b9cf-3f6144088f88 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:06.649110 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6765560c-ba0e-42c8-b9cf-3f6144088f88 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:06.649538 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6765560c-ba0e-42c8-b9cf-3f6144088f88 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:06.650301 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6765560c-ba0e-42c8-b9cf-3f6144088f88 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:06.650736 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6765560c-ba0e-42c8-b9cf-3f6144088f88 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:06.782203 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6765560c-ba0e-42c8-b9cf-3f6144088f88 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:06.790478 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6765560c-ba0e-42c8-b9cf-3f6144088f88 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:06.792007 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6765560c-ba0e-42c8-b9cf-3f6144088f88 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:06.793166 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6765560c-ba0e-42c8-b9cf-3f6144088f88 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.154944 May 13 17:37:06.793730 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 658/1333] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:37:06 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:37:07.410122 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ddada827-8f3d-45ea-ba88-b6fa90578ce5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:07.410777 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ddada827-8f3d-45ea-ba88-b6fa90578ce5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:07.418681 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ddada827-8f3d-45ea-ba88-b6fa90578ce5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:07.419845 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ddada827-8f3d-45ea-ba88-b6fa90578ce5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:07.420679 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ddada827-8f3d-45ea-ba88-b6fa90578ce5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:07.421106 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ddada827-8f3d-45ea-ba88-b6fa90578ce5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:07.489542 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ddada827-8f3d-45ea-ba88-b6fa90578ce5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:07.497320 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ddada827-8f3d-45ea-ba88-b6fa90578ce5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1381 microversion: 2.1 time: 0.091027 May 13 17:37:07.497883 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 676/1334] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:07 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1381 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:37:07.812297 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-ff77fa0f-fc79-4986-963e-3ff47a7b6e8a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:07.812957 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-ff77fa0f-fc79-4986-963e-3ff47a7b6e8a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:07.820108 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ff77fa0f-fc79-4986-963e-3ff47a7b6e8a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:07.820565 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ff77fa0f-fc79-4986-963e-3ff47a7b6e8a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:07.821359 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ff77fa0f-fc79-4986-963e-3ff47a7b6e8a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:07.821940 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ff77fa0f-fc79-4986-963e-3ff47a7b6e8a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:08.078610 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-ff77fa0f-fc79-4986-963e-3ff47a7b6e8a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:08.078610 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-ff77fa0f-fc79-4986-963e-3ff47a7b6e8a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:08.080250 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-ff77fa0f-fc79-4986-963e-3ff47a7b6e8a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:08.080250 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-ff77fa0f-fc79-4986-963e-3ff47a7b6e8a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.160394 May 13 17:37:08.080250 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 659/1335] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:37:07 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:37:08.514655 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-12c7fc1b-2f14-4964-b8d0-a63f73bb01e8 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:08.515290 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-12c7fc1b-2f14-4964-b8d0-a63f73bb01e8 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:08.522070 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-12c7fc1b-2f14-4964-b8d0-a63f73bb01e8 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:08.522511 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-12c7fc1b-2f14-4964-b8d0-a63f73bb01e8 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:08.523346 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-12c7fc1b-2f14-4964-b8d0-a63f73bb01e8 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:08.523956 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-12c7fc1b-2f14-4964-b8d0-a63f73bb01e8 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:08.589244 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-12c7fc1b-2f14-4964-b8d0-a63f73bb01e8 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:08.597828 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-12c7fc1b-2f14-4964-b8d0-a63f73bb01e8 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1381 microversion: 2.1 time: 0.086961 May 13 17:37:08.603447 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 677/1336] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:08 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1381 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:37:09.098009 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-bf725ce3-52c4-42c7-929b-392d1a035100 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:09.098615 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-bf725ce3-52c4-42c7-929b-392d1a035100 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:09.104822 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bf725ce3-52c4-42c7-929b-392d1a035100 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:09.105269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bf725ce3-52c4-42c7-929b-392d1a035100 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:09.106039 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bf725ce3-52c4-42c7-929b-392d1a035100 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:09.106474 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bf725ce3-52c4-42c7-929b-392d1a035100 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:09.232424 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-bf725ce3-52c4-42c7-929b-392d1a035100 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:09.240627 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-bf725ce3-52c4-42c7-929b-392d1a035100 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:09.242137 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-bf725ce3-52c4-42c7-929b-392d1a035100 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:09.243339 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-bf725ce3-52c4-42c7-929b-392d1a035100 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.149625 May 13 17:37:09.243958 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 660/1337] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:37:09 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:37:09.616075 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-049def40-291a-490e-9bbb-0ea499e82942 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:09.616705 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-049def40-291a-490e-9bbb-0ea499e82942 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:09.623223 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-049def40-291a-490e-9bbb-0ea499e82942 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:09.623668 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-049def40-291a-490e-9bbb-0ea499e82942 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:09.624419 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-049def40-291a-490e-9bbb-0ea499e82942 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:09.624850 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-049def40-291a-490e-9bbb-0ea499e82942 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:09.684411 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-049def40-291a-490e-9bbb-0ea499e82942 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:09.691749 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-049def40-291a-490e-9bbb-0ea499e82942 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1218 microversion: 2.1 time: 0.080177 May 13 17:37:09.692312 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 678/1338] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:09 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:37:10.261303 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-270765bc-633d-4090-9a17-e4baf827022f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:10.261917 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-270765bc-633d-4090-9a17-e4baf827022f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:10.268252 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-270765bc-633d-4090-9a17-e4baf827022f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:10.268708 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-270765bc-633d-4090-9a17-e4baf827022f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:10.269485 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-270765bc-633d-4090-9a17-e4baf827022f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:10.270494 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-270765bc-633d-4090-9a17-e4baf827022f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:10.403766 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-270765bc-633d-4090-9a17-e4baf827022f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:10.412852 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-270765bc-633d-4090-9a17-e4baf827022f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:10.417678 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-270765bc-633d-4090-9a17-e4baf827022f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:10.418863 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-270765bc-633d-4090-9a17-e4baf827022f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.161475 May 13 17:37:10.419453 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 661/1339] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:37:10 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:37:10.709130 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-89771e81-f511-4bce-bf4d-3090bfb865d8 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:10.709727 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-89771e81-f511-4bce-bf4d-3090bfb865d8 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:10.718401 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-89771e81-f511-4bce-bf4d-3090bfb865d8 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:10.718848 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-89771e81-f511-4bce-bf4d-3090bfb865d8 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:10.719655 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-89771e81-f511-4bce-bf4d-3090bfb865d8 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:10.720113 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-89771e81-f511-4bce-bf4d-3090bfb865d8 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:10.783696 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-89771e81-f511-4bce-bf4d-3090bfb865d8 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:10.791594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-89771e81-f511-4bce-bf4d-3090bfb865d8 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1218 microversion: 2.1 time: 0.086925 May 13 17:37:10.792197 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 679/1340] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:10 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:37:11.437088 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-359f8621-e1ed-49bc-8d59-34143e14b67e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:11.437698 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-359f8621-e1ed-49bc-8d59-34143e14b67e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:11.444941 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-359f8621-e1ed-49bc-8d59-34143e14b67e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:11.445388 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-359f8621-e1ed-49bc-8d59-34143e14b67e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:11.446185 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-359f8621-e1ed-49bc-8d59-34143e14b67e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:11.446619 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-359f8621-e1ed-49bc-8d59-34143e14b67e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:11.570626 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-359f8621-e1ed-49bc-8d59-34143e14b67e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:11.578345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-359f8621-e1ed-49bc-8d59-34143e14b67e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:11.579924 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-359f8621-e1ed-49bc-8d59-34143e14b67e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:11.581085 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-359f8621-e1ed-49bc-8d59-34143e14b67e tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.147928 May 13 17:37:11.581645 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 662/1341] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:37:11 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:37:11.808600 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-13950f37-b0d2-4a80-824a-2824f024c0be tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:11.809131 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-13950f37-b0d2-4a80-824a-2824f024c0be tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:11.815439 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-13950f37-b0d2-4a80-824a-2824f024c0be tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:11.815893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-13950f37-b0d2-4a80-824a-2824f024c0be tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:11.816660 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-13950f37-b0d2-4a80-824a-2824f024c0be tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:11.817100 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-13950f37-b0d2-4a80-824a-2824f024c0be tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:11.877001 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-13950f37-b0d2-4a80-824a-2824f024c0be tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:11.884563 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-13950f37-b0d2-4a80-824a-2824f024c0be tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1218 microversion: 2.1 time: 0.079840 May 13 17:37:11.885130 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 680/1342] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:11 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:37:12.599396 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-38b857b1-7f2f-4ef8-8a7b-d857c7ca4a99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:12.599933 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-38b857b1-7f2f-4ef8-8a7b-d857c7ca4a99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:12.606434 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-38b857b1-7f2f-4ef8-8a7b-d857c7ca4a99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:12.606878 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-38b857b1-7f2f-4ef8-8a7b-d857c7ca4a99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:12.607674 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-38b857b1-7f2f-4ef8-8a7b-d857c7ca4a99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:12.608108 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-38b857b1-7f2f-4ef8-8a7b-d857c7ca4a99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:12.736925 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-38b857b1-7f2f-4ef8-8a7b-d857c7ca4a99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:12.744689 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-38b857b1-7f2f-4ef8-8a7b-d857c7ca4a99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:12.752148 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-38b857b1-7f2f-4ef8-8a7b-d857c7ca4a99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:12.752148 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-38b857b1-7f2f-4ef8-8a7b-d857c7ca4a99 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.151954 May 13 17:37:12.752148 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 663/1343] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:37:12 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:37:12.901119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-499668f0-d828-4f0a-bda6-6c401a47df92 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:12.901728 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-499668f0-d828-4f0a-bda6-6c401a47df92 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:12.908051 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-499668f0-d828-4f0a-bda6-6c401a47df92 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:12.908501 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-499668f0-d828-4f0a-bda6-6c401a47df92 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:12.909274 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-499668f0-d828-4f0a-bda6-6c401a47df92 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:12.909717 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-499668f0-d828-4f0a-bda6-6c401a47df92 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:12.972117 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-499668f0-d828-4f0a-bda6-6c401a47df92 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:12.979766 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-499668f0-d828-4f0a-bda6-6c401a47df92 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1218 microversion: 2.1 time: 0.082657 May 13 17:37:12.980365 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 681/1344] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:12 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:37:13.768696 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1bd460f8-7b91-43a0-b08d-691cd1887c26 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:13.769335 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-1bd460f8-7b91-43a0-b08d-691cd1887c26 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:13.776079 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1bd460f8-7b91-43a0-b08d-691cd1887c26 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:13.776530 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1bd460f8-7b91-43a0-b08d-691cd1887c26 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:13.777295 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1bd460f8-7b91-43a0-b08d-691cd1887c26 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:13.777733 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1bd460f8-7b91-43a0-b08d-691cd1887c26 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:13.902964 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-1bd460f8-7b91-43a0-b08d-691cd1887c26 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:13.910380 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-1bd460f8-7b91-43a0-b08d-691cd1887c26 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:13.912491 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-1bd460f8-7b91-43a0-b08d-691cd1887c26 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:13.913646 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-1bd460f8-7b91-43a0-b08d-691cd1887c26 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.148823 May 13 17:37:13.914201 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 664/1345] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:37:13 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:37:13.996941 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b295405a-8724-463e-8bec-5d46e6eedc9e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:13.997548 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b295405a-8724-463e-8bec-5d46e6eedc9e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:14.003892 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b295405a-8724-463e-8bec-5d46e6eedc9e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:14.004835 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b295405a-8724-463e-8bec-5d46e6eedc9e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:14.005588 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b295405a-8724-463e-8bec-5d46e6eedc9e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:14.006016 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b295405a-8724-463e-8bec-5d46e6eedc9e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:14.064307 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b295405a-8724-463e-8bec-5d46e6eedc9e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:14.071908 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b295405a-8724-463e-8bec-5d46e6eedc9e tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1218 microversion: 2.1 time: 0.078862 May 13 17:37:14.072465 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 682/1346] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:13 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:37:14.932391 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b75ba961-4754-4665-bb56-ae350bc99e1b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:14.933002 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b75ba961-4754-4665-bb56-ae350bc99e1b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:14.939415 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b75ba961-4754-4665-bb56-ae350bc99e1b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:14.940477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b75ba961-4754-4665-bb56-ae350bc99e1b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:14.940831 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b75ba961-4754-4665-bb56-ae350bc99e1b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:14.941051 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b75ba961-4754-4665-bb56-ae350bc99e1b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:15.081862 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b75ba961-4754-4665-bb56-ae350bc99e1b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:15.088998 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-11dd799a-6f65-4f95-b582-d03c63f7b969 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:15.089602 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-11dd799a-6f65-4f95-b582-d03c63f7b969 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:15.090383 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b75ba961-4754-4665-bb56-ae350bc99e1b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:15.091938 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-b75ba961-4754-4665-bb56-ae350bc99e1b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:15.093113 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b75ba961-4754-4665-bb56-ae350bc99e1b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.164665 May 13 17:37:15.093707 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 665/1347] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:37:14 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:37:15.095776 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-11dd799a-6f65-4f95-b582-d03c63f7b969 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:15.096223 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-11dd799a-6f65-4f95-b582-d03c63f7b969 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:15.096984 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-11dd799a-6f65-4f95-b582-d03c63f7b969 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:15.097426 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-11dd799a-6f65-4f95-b582-d03c63f7b969 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:15.159042 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-11dd799a-6f65-4f95-b582-d03c63f7b969 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:15.166951 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-11dd799a-6f65-4f95-b582-d03c63f7b969 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1218 microversion: 2.1 time: 0.081752 May 13 17:37:15.167541 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 683/1348] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:15 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:37:16.112132 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-4f413e5b-762c-45c9-8733-a59125d770e1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:16.112744 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-4f413e5b-762c-45c9-8733-a59125d770e1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:16.119596 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4f413e5b-762c-45c9-8733-a59125d770e1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:16.120048 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4f413e5b-762c-45c9-8733-a59125d770e1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:16.120812 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4f413e5b-762c-45c9-8733-a59125d770e1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:16.121247 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4f413e5b-762c-45c9-8733-a59125d770e1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:16.183737 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-efe087d0-5450-4c9a-bbe4-36ef213c5141 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:16.184345 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-efe087d0-5450-4c9a-bbe4-36ef213c5141 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:16.190526 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-efe087d0-5450-4c9a-bbe4-36ef213c5141 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:16.196289 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-efe087d0-5450-4c9a-bbe4-36ef213c5141 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:16.196289 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-efe087d0-5450-4c9a-bbe4-36ef213c5141 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:16.196289 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-efe087d0-5450-4c9a-bbe4-36ef213c5141 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:16.253193 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-4f413e5b-762c-45c9-8733-a59125d770e1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:16.253753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-efe087d0-5450-4c9a-bbe4-36ef213c5141 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:16.261385 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-4f413e5b-762c-45c9-8733-a59125d770e1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:16.261586 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-efe087d0-5450-4c9a-bbe4-36ef213c5141 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1218 microversion: 2.1 time: 0.081664 May 13 17:37:16.262154 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 684/1349] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:16 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:37:16.262897 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-4f413e5b-762c-45c9-8733-a59125d770e1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:16.264091 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-4f413e5b-762c-45c9-8733-a59125d770e1 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.155859 May 13 17:37:16.264633 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 666/1350] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:37:16 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:37:17.278534 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4d3f2ca8-f20e-4217-a7dc-d5af6ce5243d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:17.279270 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4d3f2ca8-f20e-4217-a7dc-d5af6ce5243d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:17.281690 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3d6b7a2d-0d7f-40b3-86a0-f2bc672ebe3a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:17.282295 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3d6b7a2d-0d7f-40b3-86a0-f2bc672ebe3a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:17.285966 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d3f2ca8-f20e-4217-a7dc-d5af6ce5243d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:17.286793 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d3f2ca8-f20e-4217-a7dc-d5af6ce5243d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:17.287865 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d3f2ca8-f20e-4217-a7dc-d5af6ce5243d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:17.288205 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4d3f2ca8-f20e-4217-a7dc-d5af6ce5243d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:17.288771 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3d6b7a2d-0d7f-40b3-86a0-f2bc672ebe3a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:17.289267 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3d6b7a2d-0d7f-40b3-86a0-f2bc672ebe3a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:17.290173 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3d6b7a2d-0d7f-40b3-86a0-f2bc672ebe3a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:17.290618 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3d6b7a2d-0d7f-40b3-86a0-f2bc672ebe3a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:17.354279 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4d3f2ca8-f20e-4217-a7dc-d5af6ce5243d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:17.361613 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4d3f2ca8-f20e-4217-a7dc-d5af6ce5243d tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1218 microversion: 2.1 time: 0.087103 May 13 17:37:17.362194 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 685/1351] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:17 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:37:17.417726 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3d6b7a2d-0d7f-40b3-86a0-f2bc672ebe3a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:17.425412 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3d6b7a2d-0d7f-40b3-86a0-f2bc672ebe3a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:17.427430 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3d6b7a2d-0d7f-40b3-86a0-f2bc672ebe3a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:17.428592 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3d6b7a2d-0d7f-40b3-86a0-f2bc672ebe3a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.150725 May 13 17:37:17.429156 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 667/1352] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:37:17 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:37:18.380283 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3df50dd4-2c27-4359-a8e3-1d918ef93ee3 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:18.380917 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3df50dd4-2c27-4359-a8e3-1d918ef93ee3 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:18.389111 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3df50dd4-2c27-4359-a8e3-1d918ef93ee3 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:18.389111 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3df50dd4-2c27-4359-a8e3-1d918ef93ee3 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:18.389111 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3df50dd4-2c27-4359-a8e3-1d918ef93ee3 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:18.389111 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3df50dd4-2c27-4359-a8e3-1d918ef93ee3 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:18.446561 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-59318122-a718-4e58-bdb8-8b5f499e3b5c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:18.447616 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-59318122-a718-4e58-bdb8-8b5f499e3b5c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:18.453162 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-3df50dd4-2c27-4359-a8e3-1d918ef93ee3 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:18.454253 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-59318122-a718-4e58-bdb8-8b5f499e3b5c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:18.454900 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-59318122-a718-4e58-bdb8-8b5f499e3b5c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:18.455888 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-59318122-a718-4e58-bdb8-8b5f499e3b5c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:18.456471 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-59318122-a718-4e58-bdb8-8b5f499e3b5c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:18.460904 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3df50dd4-2c27-4359-a8e3-1d918ef93ee3 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1218 microversion: 2.1 time: 0.085080 May 13 17:37:18.471292 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 686/1353] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:18 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:37:18.598725 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-59318122-a718-4e58-bdb8-8b5f499e3b5c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:18.608860 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-59318122-a718-4e58-bdb8-8b5f499e3b5c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:18.610336 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-59318122-a718-4e58-bdb8-8b5f499e3b5c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:18.611502 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-59318122-a718-4e58-bdb8-8b5f499e3b5c tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.169638 May 13 17:37:18.612058 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 668/1354] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:37:18 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:37:19.477742 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-905857c9-0b6f-44b4-b2ae-f022f0ef30a6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:19.479002 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-905857c9-0b6f-44b4-b2ae-f022f0ef30a6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:19.485146 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-905857c9-0b6f-44b4-b2ae-f022f0ef30a6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:19.485594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-905857c9-0b6f-44b4-b2ae-f022f0ef30a6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:19.486358 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-905857c9-0b6f-44b4-b2ae-f022f0ef30a6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:19.486793 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-905857c9-0b6f-44b4-b2ae-f022f0ef30a6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:19.546288 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-905857c9-0b6f-44b4-b2ae-f022f0ef30a6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:19.553475 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-905857c9-0b6f-44b4-b2ae-f022f0ef30a6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1218 microversion: 2.1 time: 0.079585 May 13 17:37:19.554038 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 687/1355] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:19 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:37:19.630573 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-70801f08-d16e-468b-87d2-b11dc94af012 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:19.631240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-70801f08-d16e-468b-87d2-b11dc94af012 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:19.637492 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-70801f08-d16e-468b-87d2-b11dc94af012 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:19.637942 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-70801f08-d16e-468b-87d2-b11dc94af012 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:19.638818 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-70801f08-d16e-468b-87d2-b11dc94af012 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:19.639192 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-70801f08-d16e-468b-87d2-b11dc94af012 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:19.768740 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-70801f08-d16e-468b-87d2-b11dc94af012 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:19.776520 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-70801f08-d16e-468b-87d2-b11dc94af012 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:19.778013 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-70801f08-d16e-468b-87d2-b11dc94af012 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:19.779196 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-70801f08-d16e-468b-87d2-b11dc94af012 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.153486 May 13 17:37:19.779756 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 669/1356] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:37:19 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:37:20.569691 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5d2d9dbb-00b5-4d8c-8b06-4e294bb2f48b tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:20.570295 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5d2d9dbb-00b5-4d8c-8b06-4e294bb2f48b tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:20.576591 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5d2d9dbb-00b5-4d8c-8b06-4e294bb2f48b tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:20.577041 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5d2d9dbb-00b5-4d8c-8b06-4e294bb2f48b tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:20.577809 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5d2d9dbb-00b5-4d8c-8b06-4e294bb2f48b tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:20.578246 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5d2d9dbb-00b5-4d8c-8b06-4e294bb2f48b tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:20.639366 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5d2d9dbb-00b5-4d8c-8b06-4e294bb2f48b tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:20.647303 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5d2d9dbb-00b5-4d8c-8b06-4e294bb2f48b tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1218 microversion: 2.1 time: 0.081470 May 13 17:37:20.647870 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 688/1357] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:20 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:37:20.797473 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-36ca202b-36d4-4b08-a44e-1533681a3d34 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:20.798026 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-36ca202b-36d4-4b08-a44e-1533681a3d34 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:20.804446 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-36ca202b-36d4-4b08-a44e-1533681a3d34 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:20.804901 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-36ca202b-36d4-4b08-a44e-1533681a3d34 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:20.805671 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-36ca202b-36d4-4b08-a44e-1533681a3d34 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:20.806111 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-36ca202b-36d4-4b08-a44e-1533681a3d34 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:20.936324 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-36ca202b-36d4-4b08-a44e-1533681a3d34 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:20.944439 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-36ca202b-36d4-4b08-a44e-1533681a3d34 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:20.945919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-36ca202b-36d4-4b08-a44e-1533681a3d34 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:20.947081 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-36ca202b-36d4-4b08-a44e-1533681a3d34 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.153557 May 13 17:37:20.947667 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 670/1358] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:37:20 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:37:21.664276 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5e6ef829-94c0-49f8-90c4-11f32cae47d6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:21.664880 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5e6ef829-94c0-49f8-90c4-11f32cae47d6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:21.671098 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5e6ef829-94c0-49f8-90c4-11f32cae47d6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:21.671578 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5e6ef829-94c0-49f8-90c4-11f32cae47d6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:21.672347 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5e6ef829-94c0-49f8-90c4-11f32cae47d6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:21.672784 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5e6ef829-94c0-49f8-90c4-11f32cae47d6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:21.737389 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-5e6ef829-94c0-49f8-90c4-11f32cae47d6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:21.745463 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5e6ef829-94c0-49f8-90c4-11f32cae47d6 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1218 microversion: 2.1 time: 0.085422 May 13 17:37:21.746037 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 689/1359] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:21 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:37:21.964822 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-fa775b71-f064-4ab5-92c6-91752ba5c97f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:21.965429 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-fa775b71-f064-4ab5-92c6-91752ba5c97f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:21.971785 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fa775b71-f064-4ab5-92c6-91752ba5c97f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:21.972233 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fa775b71-f064-4ab5-92c6-91752ba5c97f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:21.973563 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fa775b71-f064-4ab5-92c6-91752ba5c97f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:21.973995 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fa775b71-f064-4ab5-92c6-91752ba5c97f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:22.098492 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-fa775b71-f064-4ab5-92c6-91752ba5c97f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:22.106501 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-fa775b71-f064-4ab5-92c6-91752ba5c97f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:22.108031 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-fa775b71-f064-4ab5-92c6-91752ba5c97f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:22.109205 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-fa775b71-f064-4ab5-92c6-91752ba5c97f tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.148310 May 13 17:37:22.109762 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 671/1360] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:37:21 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:37:22.762231 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-08e9eb46-f6cd-4806-888f-b17defafcaf5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:22.762838 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-08e9eb46-f6cd-4806-888f-b17defafcaf5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:22.769307 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-08e9eb46-f6cd-4806-888f-b17defafcaf5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:22.769762 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-08e9eb46-f6cd-4806-888f-b17defafcaf5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:22.770538 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-08e9eb46-f6cd-4806-888f-b17defafcaf5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:22.770975 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-08e9eb46-f6cd-4806-888f-b17defafcaf5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:22.833221 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-08e9eb46-f6cd-4806-888f-b17defafcaf5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:22.840572 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-08e9eb46-f6cd-4806-888f-b17defafcaf5 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1218 microversion: 2.1 time: 0.082193 May 13 17:37:22.841147 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 690/1361] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:22 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:37:23.129413 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-f8278087-9f07-4a6d-bccd-4fcf759e0aa4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:23.130016 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-f8278087-9f07-4a6d-bccd-4fcf759e0aa4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:23.136391 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f8278087-9f07-4a6d-bccd-4fcf759e0aa4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:23.136843 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f8278087-9f07-4a6d-bccd-4fcf759e0aa4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:23.138415 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f8278087-9f07-4a6d-bccd-4fcf759e0aa4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:23.138799 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-f8278087-9f07-4a6d-bccd-4fcf759e0aa4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:23.265595 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f8278087-9f07-4a6d-bccd-4fcf759e0aa4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:23.273472 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f8278087-9f07-4a6d-bccd-4fcf759e0aa4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:23.274963 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-f8278087-9f07-4a6d-bccd-4fcf759e0aa4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:23.276141 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-f8278087-9f07-4a6d-bccd-4fcf759e0aa4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.152285 May 13 17:37:23.276705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 672/1362] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:37:23 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:37:23.856693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d199d99b-c6cd-44e1-bbe2-293954e71f26 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:23.857382 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d199d99b-c6cd-44e1-bbe2-293954e71f26 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:23.863736 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d199d99b-c6cd-44e1-bbe2-293954e71f26 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:23.864188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d199d99b-c6cd-44e1-bbe2-293954e71f26 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:23.865614 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d199d99b-c6cd-44e1-bbe2-293954e71f26 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:23.866051 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-d199d99b-c6cd-44e1-bbe2-293954e71f26 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:23.925653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d199d99b-c6cd-44e1-bbe2-293954e71f26 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:23.933624 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d199d99b-c6cd-44e1-bbe2-293954e71f26 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1218 microversion: 2.1 time: 0.081213 May 13 17:37:23.934411 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 691/1363] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:23 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:37:24.294659 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-224fef60-cba8-48c1-a38f-b4a7dd131bb5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:24.295228 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-224fef60-cba8-48c1-a38f-b4a7dd131bb5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:24.301829 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-224fef60-cba8-48c1-a38f-b4a7dd131bb5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:24.302289 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-224fef60-cba8-48c1-a38f-b4a7dd131bb5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:24.303062 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-224fef60-cba8-48c1-a38f-b4a7dd131bb5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:24.303533 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-224fef60-cba8-48c1-a38f-b4a7dd131bb5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:24.429983 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-224fef60-cba8-48c1-a38f-b4a7dd131bb5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:24.437686 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-224fef60-cba8-48c1-a38f-b4a7dd131bb5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:24.439232 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-224fef60-cba8-48c1-a38f-b4a7dd131bb5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:24.440404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-224fef60-cba8-48c1-a38f-b4a7dd131bb5 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.149738 May 13 17:37:24.440976 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 673/1364] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:37:24 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:37:24.949661 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-67dee1ed-7bf3-401a-bc91-cca0dd4fa704 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:24.950303 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-67dee1ed-7bf3-401a-bc91-cca0dd4fa704 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:24.956905 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-67dee1ed-7bf3-401a-bc91-cca0dd4fa704 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:24.957358 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-67dee1ed-7bf3-401a-bc91-cca0dd4fa704 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:24.958693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-67dee1ed-7bf3-401a-bc91-cca0dd4fa704 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:24.959308 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-67dee1ed-7bf3-401a-bc91-cca0dd4fa704 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:24.990047 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-67dee1ed-7bf3-401a-bc91-cca0dd4fa704 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:24.990419 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-67dee1ed-7bf3-401a-bc91-cca0dd4fa704 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:24.990863 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-67dee1ed-7bf3-401a-bc91-cca0dd4fa704 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lazy-loading 'fault' on Instance uuid 7a310844-e208-4f17-a8c9-fd4db4acf00d {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:37:25.030025 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-67dee1ed-7bf3-401a-bc91-cca0dd4fa704 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72919bd9efe84fa8acf2b407d7b6b13d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15f2d05b5ad248009d2acb0d3db6aec9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:25.037858 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-67dee1ed-7bf3-401a-bc91-cca0dd4fa704 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 200 len: 1223 microversion: 2.1 time: 0.092003 May 13 17:37:25.038454 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 692/1365] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:24 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:37:25.266567 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-8f646059-4e5c-46e8-9487-5311601e5282 req-d9f8ef58-b4df-4965-acdf-1521e41fbfac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e3c7f8-88a0-4922-9bbe-0ebf07125a8a", "name": "network-vif-plugged", "status": "completed", "tag": "acf21395-ff17-45fa-b717-d3bb2054575b"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:37:25.276057 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-8f646059-4e5c-46e8-9487-5311601e5282 req-d9f8ef58-b4df-4965-acdf-1521e41fbfac service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:25.276837 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-8f646059-4e5c-46e8-9487-5311601e5282 req-d9f8ef58-b4df-4965-acdf-1521e41fbfac service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:25.288763 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-8f646059-4e5c-46e8-9487-5311601e5282 req-d9f8ef58-b4df-4965-acdf-1521e41fbfac service nova] Creating event network-vif-plugged:acf21395-ff17-45fa-b717-d3bb2054575b for instance 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a on hv-cinder-84178 May 13 17:37:25.294374 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-8f646059-4e5c-46e8-9487-5311601e5282 req-d9f8ef58-b4df-4965-acdf-1521e41fbfac service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094385 May 13 17:37:25.295292 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 674/1366] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:37:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:37:25.460359 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e91c66e6-dfe1-4bf0-8cb9-14bd5f9a8b12 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:25.460968 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e91c66e6-dfe1-4bf0-8cb9-14bd5f9a8b12 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:25.467020 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e91c66e6-dfe1-4bf0-8cb9-14bd5f9a8b12 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:25.467505 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e91c66e6-dfe1-4bf0-8cb9-14bd5f9a8b12 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:25.468275 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e91c66e6-dfe1-4bf0-8cb9-14bd5f9a8b12 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:25.468716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e91c66e6-dfe1-4bf0-8cb9-14bd5f9a8b12 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:25.601243 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e91c66e6-dfe1-4bf0-8cb9-14bd5f9a8b12 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:25.609570 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e91c66e6-dfe1-4bf0-8cb9-14bd5f9a8b12 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:25.611082 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-e91c66e6-dfe1-4bf0-8cb9-14bd5f9a8b12 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:25.612285 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e91c66e6-dfe1-4bf0-8cb9-14bd5f9a8b12 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.156563 May 13 17:37:25.612884 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 693/1367] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:37:25 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:37:26.024130 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1f751897-d2af-4276-90fb-49e4b5f69b7b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:26.025196 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-1f751897-d2af-4276-90fb-49e4b5f69b7b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:26.031731 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1f751897-d2af-4276-90fb-49e4b5f69b7b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:26.032192 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1f751897-d2af-4276-90fb-49e4b5f69b7b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:26.032961 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1f751897-d2af-4276-90fb-49e4b5f69b7b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:26.033402 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1f751897-d2af-4276-90fb-49e4b5f69b7b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:26.055289 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-03e62f81-1e80-4d19-aa20-7801f14862e9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:26.055901 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-03e62f81-1e80-4d19-aa20-7801f14862e9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] [instance: 7a310844-e208-4f17-a8c9-fd4db4acf00d] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:26.062204 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-03e62f81-1e80-4d19-aa20-7801f14862e9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:26.062599 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-03e62f81-1e80-4d19-aa20-7801f14862e9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:26.063335 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-1f751897-d2af-4276-90fb-49e4b5f69b7b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043522 May 13 17:37:26.063461 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-03e62f81-1e80-4d19-aa20-7801f14862e9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:26.063831 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-03e62f81-1e80-4d19-aa20-7801f14862e9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:26.063934 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 675/1368] 10.222.0.64 () {58 vars in 1301 bytes} [Fri May 13 17:37:26 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:37:26.073506 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a2e8b963-f840-418d-9aac-2df3935b0809 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:26.074002 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a2e8b963-f840-418d-9aac-2df3935b0809 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:26.077064 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-03e62f81-1e80-4d19-aa20-7801f14862e9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] HTTP exception thrown: Instance 7a310844-e208-4f17-a8c9-fd4db4acf00d could not be found. May 13 17:37:26.078724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-03e62f81-1e80-4d19-aa20-7801f14862e9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Request method failure captured: May 13 17:37:26.078724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d HTTP/1.1 May 13 17:37:26.078724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:37:26.078724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:37:26.078724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:37:26.078724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:37:26.078724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:37:26.078724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:37:26.078724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:37:26.078724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:37:26.078724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpVetnWs-S6luEFxnZAkCj0iYN_bpexGgAa09YzLf2F7ElihdWMnACnk9d4ASRLeSb9B4IATJ8H3PzJ_HiQNCLKVRHG2T6sRmijOEW3mf8odGCnsNQ70JERflHtHmgsJ3lcQ3CNPi2Vkxsv5yUR_EHFt3LAjK521Yylit8fDZ9sGxGM May 13 17:37:26.078724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:37:26.078724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:37:26.078724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:37:26.078724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:37:26.078724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:37:26.078724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:37:26.078724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 15f2d05b5ad248009d2acb0d3db6aec9 May 13 17:37:26.078724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-TestShelveInstance-1832523296 May 13 17:37:26.078724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:37:26.078724 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:37:26.080420 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/15f2d05b5ad248009d2acb0d3db6aec9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/15f2d05b5ad248009d2acb0d3db6aec9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_15f2d05b5ad248009d2acb0d3db6aec9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/15f2d05b5ad248009d2acb0d3db6aec9"}]}] May 13 17:37:26.080420 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-TestShelveInstance-1832523296 May 13 17:37:26.080420 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 15f2d05b5ad248009d2acb0d3db6aec9 May 13 17:37:26.080420 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-TestShelveInstance-1832523296 May 13 17:37:26.080420 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-TestShelveInstance-1832523296-project May 13 17:37:26.080420 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:37:26.080420 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:37:26.080420 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: 72919bd9efe84fa8acf2b407d7b6b13d May 13 17:37:26.080420 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-TestShelveInstance-1832523296-project May 13 17:37:26.080420 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: > May 13 17:37:26.080420 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Instance 7a310844-e208-4f17-a8c9-fd4db4acf00d could not be found. May 13 17:37:26.080420 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '7a310844-e208-4f17-a8c9-fd4db4acf00d'} May 13 17:37:26.081436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:37:26.081436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:37:26.081436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:37:26.081436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:37:26.081436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:37:26.081436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:37:26.081436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:37:26.081436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:37:26.081436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:37:26.081436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:37:26.081436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a310844-e208-4f17-a8c9-fd4db4acf00d could not be found. May 13 17:37:26.081436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:37:26.081436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:37:26.081436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:37:26.081436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:37:26.081436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:37:26.081436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:37:26.081436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:37:26.081436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:37:26.081436 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:37:26.082741 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:37:26.082741 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:37:26.082741 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:37:26.082741 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:37:26.082741 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:37:26.082741 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:37:26.082741 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:37:26.082741 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a310844-e208-4f17-a8c9-fd4db4acf00d could not be found. May 13 17:37:26.082741 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:37:26.082741 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:37:26.082741 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:37:26.082741 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:37:26.082741 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:37:26.082741 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:37:26.082741 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:37:26.082741 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:37:26.082741 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a310844-e208-4f17-a8c9-fd4db4acf00d could not be found. May 13 17:37:26.082741 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:37:26.084069 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-03e62f81-1e80-4d19-aa20-7801f14862e9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Returning 404 to user: Instance 7a310844-e208-4f17-a8c9-fd4db4acf00d could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:37:26.084158 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a2e8b963-f840-418d-9aac-2df3935b0809 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:26.084692 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-03e62f81-1e80-4d19-aa20-7801f14862e9 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d" status: 404 len: 111 microversion: 2.1 time: 0.029341 May 13 17:37:26.084786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a2e8b963-f840-418d-9aac-2df3935b0809 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:26.084786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a2e8b963-f840-418d-9aac-2df3935b0809 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:26.084944 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 694/1369] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:26 2022] GET /compute/v2.1/servers/7a310844-e208-4f17-a8c9-fd4db4acf00d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 17:37:26.085029 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a2e8b963-f840-418d-9aac-2df3935b0809 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:26.110384 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a2e8b963-f840-418d-9aac-2df3935b0809 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e/os-volume_attachments/ee980cf4-10a5-4036-8610-85546f4515ed" status: 200 len: 194 microversion: 2.1 time: 0.040576 May 13 17:37:26.110992 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 676/1370] 10.222.0.64 () {58 vars in 1412 bytes} [Fri May 13 17:37:26 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e/os-volume_attachments/ee980cf4-10a5-4036-8610-85546f4515ed => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:37:26.342320 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-85ffc448-9fe0-4b3b-bd58-265738702ba7 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] Calling method '.version_select at 0x7fa084512ee0>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:26.417528 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-85ffc448-9fe0-4b3b-bd58-265738702ba7 tempest-TestShelveInstance-1832523296 tempest-TestShelveInstance-1832523296-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-442032391" status: 202 len: 0 microversion: 2.1 time: 0.079224 May 13 17:37:26.418117 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 695/1371] 10.222.0.64 () {58 vars in 1250 bytes} [Fri May 13 17:37:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-442032391 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:37:26.635573 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-bca0487c-4297-43bf-bcd7-a9eb96a3f1c2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:26.636285 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-bca0487c-4297-43bf-bcd7-a9eb96a3f1c2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:26.643452 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bca0487c-4297-43bf-bcd7-a9eb96a3f1c2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:26.643909 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bca0487c-4297-43bf-bcd7-a9eb96a3f1c2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:26.644787 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bca0487c-4297-43bf-bcd7-a9eb96a3f1c2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:26.645179 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bca0487c-4297-43bf-bcd7-a9eb96a3f1c2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:26.790149 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-bca0487c-4297-43bf-bcd7-a9eb96a3f1c2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:26.799617 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-bca0487c-4297-43bf-bcd7-a9eb96a3f1c2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:26.801230 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-bca0487c-4297-43bf-bcd7-a9eb96a3f1c2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:26.802471 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-bca0487c-4297-43bf-bcd7-a9eb96a3f1c2 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.173853 May 13 17:37:26.803362 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 677/1372] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:37:26 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:37:27.821118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fda3d25f-8034-4576-93ee-27218432787b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:27.821725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fda3d25f-8034-4576-93ee-27218432787b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:27.828284 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fda3d25f-8034-4576-93ee-27218432787b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:27.828736 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fda3d25f-8034-4576-93ee-27218432787b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:27.829520 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fda3d25f-8034-4576-93ee-27218432787b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:27.829958 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fda3d25f-8034-4576-93ee-27218432787b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:28.064109 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fda3d25f-8034-4576-93ee-27218432787b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:28.072450 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fda3d25f-8034-4576-93ee-27218432787b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:28.073956 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-fda3d25f-8034-4576-93ee-27218432787b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:28.075121 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fda3d25f-8034-4576-93ee-27218432787b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.258487 May 13 17:37:28.075723 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 696/1373] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:37:27 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:37:29.093524 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3e00b12c-bb49-457f-a386-bd4e64c14d53 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:29.094737 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3e00b12c-bb49-457f-a386-bd4e64c14d53 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:29.102103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3e00b12c-bb49-457f-a386-bd4e64c14d53 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:29.102559 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3e00b12c-bb49-457f-a386-bd4e64c14d53 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:29.103634 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3e00b12c-bb49-457f-a386-bd4e64c14d53 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:29.104075 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3e00b12c-bb49-457f-a386-bd4e64c14d53 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:29.246535 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3e00b12c-bb49-457f-a386-bd4e64c14d53 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:29.256998 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3e00b12c-bb49-457f-a386-bd4e64c14d53 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:29.256998 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-3e00b12c-bb49-457f-a386-bd4e64c14d53 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:29.257449 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3e00b12c-bb49-457f-a386-bd4e64c14d53 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1731 microversion: 2.20 time: 0.167946 May 13 17:37:29.258016 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 678/1374] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:37:29 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:37:29.961290 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-526575c9-6755-4659-adfe-dd1f3ae6ada4 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "953dea7d-d9b9-4cac-8454-8caa1bb5b3ae"}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:37:29.962573 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-526575c9-6755-4659-adfe-dd1f3ae6ada4 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:29.973068 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-526575c9-6755-4659-adfe-dd1f3ae6ada4 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:29.973444 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-526575c9-6755-4659-adfe-dd1f3ae6ada4 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:29.982709 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-526575c9-6755-4659-adfe-dd1f3ae6ada4 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:29.982709 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-526575c9-6755-4659-adfe-dd1f3ae6ada4 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:30.276090 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a4b01250-9957-42c5-8abb-1297dd707546 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:30.276677 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a4b01250-9957-42c5-8abb-1297dd707546 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:30.282485 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a4b01250-9957-42c5-8abb-1297dd707546 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:30.282943 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a4b01250-9957-42c5-8abb-1297dd707546 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:30.283767 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a4b01250-9957-42c5-8abb-1297dd707546 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:30.284191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a4b01250-9957-42c5-8abb-1297dd707546 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:30.428036 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a4b01250-9957-42c5-8abb-1297dd707546 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:30.435874 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a4b01250-9957-42c5-8abb-1297dd707546 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:30.437436 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a4b01250-9957-42c5-8abb-1297dd707546 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:30.438610 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a4b01250-9957-42c5-8abb-1297dd707546 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1718 microversion: 2.20 time: 0.167868 May 13 17:37:30.439217 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 679/1375] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:37:30 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1718 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:37:30.747231 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-526575c9-6755-4659-adfe-dd1f3ae6ada4 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "POST /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.797263 May 13 17:37:30.747879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 697/1376] 10.222.0.64 () {60 vars in 1322 bytes} [Fri May 13 17:37:29 2022] POST /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e/os-volume_attachments => generated 194 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:37:40.356008 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d765309b-1d1b-4c0e-9edd-c0e4408fcef8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:40.356984 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d765309b-1d1b-4c0e-9edd-c0e4408fcef8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:40.363636 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d765309b-1d1b-4c0e-9edd-c0e4408fcef8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:40.367099 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d765309b-1d1b-4c0e-9edd-c0e4408fcef8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:40.367099 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d765309b-1d1b-4c0e-9edd-c0e4408fcef8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:40.367099 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d765309b-1d1b-4c0e-9edd-c0e4408fcef8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:40.394652 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d765309b-1d1b-4c0e-9edd-c0e4408fcef8 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042794 May 13 17:37:40.395306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 680/1377] 10.222.0.64 () {58 vars in 1301 bytes} [Fri May 13 17:37:40 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:37:40.535494 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e6d48e71-ff8e-4916-be1f-e2946178f290 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:40.536077 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-e6d48e71-ff8e-4916-be1f-e2946178f290 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:40.542119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e6d48e71-ff8e-4916-be1f-e2946178f290 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:40.542573 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e6d48e71-ff8e-4916-be1f-e2946178f290 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:40.543374 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e6d48e71-ff8e-4916-be1f-e2946178f290 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:40.543816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-e6d48e71-ff8e-4916-be1f-e2946178f290 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:40.574642 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e6d48e71-ff8e-4916-be1f-e2946178f290 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e/os-volume_attachments/ee980cf4-10a5-4036-8610-85546f4515ed" status: 200 len: 194 microversion: 2.1 time: 0.044021 May 13 17:37:40.575249 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 698/1378] 10.222.0.64 () {58 vars in 1412 bytes} [Fri May 13 17:37:40 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e/os-volume_attachments/ee980cf4-10a5-4036-8610-85546f4515ed => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:37:40.585196 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1a83760c-531b-4945-90f3-41352842217b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:40.585787 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-1a83760c-531b-4945-90f3-41352842217b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:40.591796 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1a83760c-531b-4945-90f3-41352842217b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:40.592250 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1a83760c-531b-4945-90f3-41352842217b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:40.593022 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1a83760c-531b-4945-90f3-41352842217b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:40.593488 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1a83760c-531b-4945-90f3-41352842217b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:40.672173 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.objects.instance [None req-1a83760c-531b-4945-90f3-41352842217b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lazy-loading 'services' on Instance uuid aade165c-bc0d-4b1d-9d9e-2f7aced9a29e {{(pid=117492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:37:40.857163 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-1a83760c-531b-4945-90f3-41352842217b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "DELETE /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e/os-volume_attachments/ee980cf4-10a5-4036-8610-85546f4515ed" status: 202 len: 0 microversion: 2.1 time: 0.276015 May 13 17:37:40.858016 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 681/1379] 10.222.0.64 () {58 vars in 1415 bytes} [Fri May 13 17:37:40 2022] DELETE /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e/os-volume_attachments/ee980cf4-10a5-4036-8610-85546f4515ed => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:37:43.168213 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2c68fa68-7efb-4890-ad3f-9579af8d0379 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:43.168773 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2c68fa68-7efb-4890-ad3f-9579af8d0379 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:43.174692 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2c68fa68-7efb-4890-ad3f-9579af8d0379 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:43.175172 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2c68fa68-7efb-4890-ad3f-9579af8d0379 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:43.175984 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2c68fa68-7efb-4890-ad3f-9579af8d0379 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:43.176429 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2c68fa68-7efb-4890-ad3f-9579af8d0379 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:43.204846 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2c68fa68-7efb-4890-ad3f-9579af8d0379 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e/os-volume_attachments/953dea7d-d9b9-4cac-8454-8caa1bb5b3ae" status: 200 len: 194 microversion: 2.1 time: 0.040554 May 13 17:37:43.205426 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 699/1380] 10.222.0.64 () {58 vars in 1412 bytes} [Fri May 13 17:37:43 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e/os-volume_attachments/953dea7d-d9b9-4cac-8454-8caa1bb5b3ae => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:37:43.216222 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b6a5b137-61d5-4b43-947e-3ac4496cad48 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:43.216801 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b6a5b137-61d5-4b43-947e-3ac4496cad48 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:43.223354 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b6a5b137-61d5-4b43-947e-3ac4496cad48 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:43.223800 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b6a5b137-61d5-4b43-947e-3ac4496cad48 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:43.224557 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b6a5b137-61d5-4b43-947e-3ac4496cad48 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:43.225017 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b6a5b137-61d5-4b43-947e-3ac4496cad48 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:43.303009 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.objects.instance [None req-b6a5b137-61d5-4b43-947e-3ac4496cad48 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lazy-loading 'services' on Instance uuid aade165c-bc0d-4b1d-9d9e-2f7aced9a29e {{(pid=117492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:37:43.490581 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b6a5b137-61d5-4b43-947e-3ac4496cad48 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "DELETE /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e/os-volume_attachments/953dea7d-d9b9-4cac-8454-8caa1bb5b3ae" status: 202 len: 0 microversion: 2.1 time: 0.278536 May 13 17:37:43.491199 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 682/1381] 10.222.0.64 () {58 vars in 1415 bytes} [Fri May 13 17:37:43 2022] DELETE /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e/os-volume_attachments/953dea7d-d9b9-4cac-8454-8caa1bb5b3ae => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:37:44.650127 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5141c2ac-e845-4352-bc43-de35831419aa tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:44.651114 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5141c2ac-e845-4352-bc43-de35831419aa tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:44.657375 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5141c2ac-e845-4352-bc43-de35831419aa tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:44.657831 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5141c2ac-e845-4352-bc43-de35831419aa tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:44.658613 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5141c2ac-e845-4352-bc43-de35831419aa tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:44.659056 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5141c2ac-e845-4352-bc43-de35831419aa tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:44.689960 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5141c2ac-e845-4352-bc43-de35831419aa tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042445 May 13 17:37:44.689960 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 700/1382] 10.222.0.64 () {58 vars in 1301 bytes} [Fri May 13 17:37:44 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 17:37:44.797456 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d44ff1bb-897e-406d-b012-48a1a8f0dcba tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:44.799444 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d44ff1bb-897e-406d-b012-48a1a8f0dcba tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:44.810920 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d44ff1bb-897e-406d-b012-48a1a8f0dcba tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:44.811737 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d44ff1bb-897e-406d-b012-48a1a8f0dcba tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:44.812827 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d44ff1bb-897e-406d-b012-48a1a8f0dcba tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:44.813283 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d44ff1bb-897e-406d-b012-48a1a8f0dcba tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:44.841431 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d44ff1bb-897e-406d-b012-48a1a8f0dcba tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049891 May 13 17:37:44.841993 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 683/1383] 10.222.0.64 () {58 vars in 1301 bytes} [Fri May 13 17:37:44 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 17:37:44.899744 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-86facf8a-060e-459d-9cc0-06f6c0735525 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:44.906287 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-86facf8a-060e-459d-9cc0-06f6c0735525 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:44.906287 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-86facf8a-060e-459d-9cc0-06f6c0735525 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:44.906743 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-86facf8a-060e-459d-9cc0-06f6c0735525 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:44.907540 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-86facf8a-060e-459d-9cc0-06f6c0735525 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:44.907982 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-86facf8a-060e-459d-9cc0-06f6c0735525 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:44.932355 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-86facf8a-060e-459d-9cc0-06f6c0735525 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Going to try to terminate instance {{(pid=117493) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 17:37:45.188644 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-86facf8a-060e-459d-9cc0-06f6c0735525 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "DELETE /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e" status: 204 len: 0 microversion: 2.1 time: 0.293110 May 13 17:37:45.189206 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 701/1384] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:37:44 2022] DELETE /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 17:37:45.197666 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-38373f21-14ce-4fee-b5f7-156ff747dcc7 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:45.205807 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-38373f21-14ce-4fee-b5f7-156ff747dcc7 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:45.205807 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-38373f21-14ce-4fee-b5f7-156ff747dcc7 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:45.205807 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-38373f21-14ce-4fee-b5f7-156ff747dcc7 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:45.205807 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-38373f21-14ce-4fee-b5f7-156ff747dcc7 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:45.206186 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-38373f21-14ce-4fee-b5f7-156ff747dcc7 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:45.334809 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-38373f21-14ce-4fee-b5f7-156ff747dcc7 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:45.342183 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-38373f21-14ce-4fee-b5f7-156ff747dcc7 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e" status: 200 len: 1673 microversion: 2.1 time: 0.148807 May 13 17:37:45.342761 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 684/1385] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:45 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:37:46.361009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4b35b75b-781c-47bd-b0f6-900fb6334e05 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:46.361733 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4b35b75b-781c-47bd-b0f6-900fb6334e05 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:46.368019 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4b35b75b-781c-47bd-b0f6-900fb6334e05 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:46.368472 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4b35b75b-781c-47bd-b0f6-900fb6334e05 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:46.369239 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4b35b75b-781c-47bd-b0f6-900fb6334e05 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:46.369682 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4b35b75b-781c-47bd-b0f6-900fb6334e05 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:46.499793 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4b35b75b-781c-47bd-b0f6-900fb6334e05 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:46.507742 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4b35b75b-781c-47bd-b0f6-900fb6334e05 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e" status: 200 len: 1673 microversion: 2.1 time: 0.151093 May 13 17:37:46.508316 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 702/1386] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:46 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:37:47.525362 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1dcc65fe-9a7d-4721-800c-662ab70ea1eb tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:47.526060 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-1dcc65fe-9a7d-4721-800c-662ab70ea1eb tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:47.532663 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1dcc65fe-9a7d-4721-800c-662ab70ea1eb tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:47.533119 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1dcc65fe-9a7d-4721-800c-662ab70ea1eb tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:47.533909 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1dcc65fe-9a7d-4721-800c-662ab70ea1eb tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:47.534352 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1dcc65fe-9a7d-4721-800c-662ab70ea1eb tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:47.741141 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-1dcc65fe-9a7d-4721-800c-662ab70ea1eb tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:47.748779 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-1dcc65fe-9a7d-4721-800c-662ab70ea1eb tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e" status: 200 len: 1673 microversion: 2.1 time: 0.227906 May 13 17:37:47.758359 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 685/1387] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:47 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e => generated 1673 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:37:48.593810 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-48c7529b-e0c1-4c06-9fe5-f3782ae3d6ac req-4553e999-5398-4032-840a-60d3ff8912ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aade165c-bc0d-4b1d-9d9e-2f7aced9a29e", "name": "network-vif-deleted", "tag": "ef8c1db6-43b0-4b4c-87b2-f41b6f47d816"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:37:48.604723 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-48c7529b-e0c1-4c06-9fe5-f3782ae3d6ac req-4553e999-5398-4032-840a-60d3ff8912ff service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:48.605188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-48c7529b-e0c1-4c06-9fe5-f3782ae3d6ac req-4553e999-5398-4032-840a-60d3ff8912ff service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:48.618489 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-48c7529b-e0c1-4c06-9fe5-f3782ae3d6ac req-4553e999-5398-4032-840a-60d3ff8912ff service nova] Creating event network-vif-deleted:ef8c1db6-43b0-4b4c-87b2-f41b6f47d816 for instance aade165c-bc0d-4b1d-9d9e-2f7aced9a29e on hv-cinder-84178 May 13 17:37:48.624674 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-48c7529b-e0c1-4c06-9fe5-f3782ae3d6ac req-4553e999-5398-4032-840a-60d3ff8912ff service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217870 May 13 17:37:48.626297 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 703/1388] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:37:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:37:48.765939 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-dd2e1f87-aaab-4fde-b958-dfe72c7e2bb4 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:48.766580 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-dd2e1f87-aaab-4fde-b958-dfe72c7e2bb4 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:48.775064 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dd2e1f87-aaab-4fde-b958-dfe72c7e2bb4 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:48.775547 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dd2e1f87-aaab-4fde-b958-dfe72c7e2bb4 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:48.776332 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dd2e1f87-aaab-4fde-b958-dfe72c7e2bb4 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:48.776811 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-dd2e1f87-aaab-4fde-b958-dfe72c7e2bb4 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:48.846328 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-dd2e1f87-aaab-4fde-b958-dfe72c7e2bb4 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efc23cbdbebc423baed1a2cb6c6cd7e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f8e7b818f3a74fc48f0faeeb3398069a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:37:48.854346 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-dd2e1f87-aaab-4fde-b958-dfe72c7e2bb4 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e" status: 200 len: 1322 microversion: 2.1 time: 0.091900 May 13 17:37:48.858348 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 686/1389] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:48 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e => generated 1322 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:37:49.872372 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-44caf6fc-02b5-450f-ade3-1484ac52cb23 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:49.873168 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-44caf6fc-02b5-450f-ade3-1484ac52cb23 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:49.879343 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-44caf6fc-02b5-450f-ade3-1484ac52cb23 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:49.879800 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-44caf6fc-02b5-450f-ade3-1484ac52cb23 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:49.880570 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-44caf6fc-02b5-450f-ade3-1484ac52cb23 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:49.881050 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-44caf6fc-02b5-450f-ade3-1484ac52cb23 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:49.893811 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-44caf6fc-02b5-450f-ade3-1484ac52cb23 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] HTTP exception thrown: Instance aade165c-bc0d-4b1d-9d9e-2f7aced9a29e could not be found. May 13 17:37:49.895816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-44caf6fc-02b5-450f-ade3-1484ac52cb23 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Request method failure captured: May 13 17:37:49.895816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e HTTP/1.1 May 13 17:37:49.895816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:37:49.895816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:37:49.895816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:37:49.895816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:37:49.895816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:37:49.895816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:37:49.895816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:37:49.895816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:37:49.895816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpTdLnBC38r4Fsk9gF4Q-qgew3N3xjHhysfU0GZ-tBIod1vsC397_Sdc9w8yS8dTL3JtngECr8kriEYGXb2K57w2zELiJFXMiTm7t-oES09p5xGMFJ4DBpSXhYJTVYXQuAVegMjasycGrLXLNpygd-WetdBy4ZYTGGIVOgqJHlQUF5Y May 13 17:37:49.895816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:37:49.895816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:37:49.895816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:37:49.895816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:37:49.895816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:37:49.895816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:37:49.895816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: f8e7b818f3a74fc48f0faeeb3398069a May 13 17:37:49.895816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-AttachVolumeTestJSON-878348621 May 13 17:37:49.895816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:37:49.895816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:37:49.898612 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f8e7b818f3a74fc48f0faeeb3398069a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f8e7b818f3a74fc48f0faeeb3398069a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f8e7b818f3a74fc48f0faeeb3398069a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f8e7b818f3a74fc48f0faeeb3398069a"}]}] May 13 17:37:49.898612 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-AttachVolumeTestJSON-878348621 May 13 17:37:49.898612 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: f8e7b818f3a74fc48f0faeeb3398069a May 13 17:37:49.898612 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-AttachVolumeTestJSON-878348621 May 13 17:37:49.898612 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-AttachVolumeTestJSON-878348621-project May 13 17:37:49.898612 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:37:49.898612 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:37:49.898612 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: efc23cbdbebc423baed1a2cb6c6cd7e7 May 13 17:37:49.898612 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-AttachVolumeTestJSON-878348621-project May 13 17:37:49.898612 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: > May 13 17:37:49.898612 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Instance aade165c-bc0d-4b1d-9d9e-2f7aced9a29e could not be found. May 13 17:37:49.898612 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'id': 'aade165c-bc0d-4b1d-9d9e-2f7aced9a29e'} May 13 17:37:49.899879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:37:49.899879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:37:49.899879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:37:49.899879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:37:49.899879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:37:49.899879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:37:49.899879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:37:49.899879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:37:49.899879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:37:49.899879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:37:49.899879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aade165c-bc0d-4b1d-9d9e-2f7aced9a29e could not be found. May 13 17:37:49.899879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:37:49.899879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:37:49.899879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:37:49.899879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:37:49.899879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:37:49.899879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:37:49.899879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:37:49.899879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:37:49.899879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:37:49.901639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:37:49.901639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:37:49.901639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:37:49.901639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:37:49.901639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:37:49.901639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:37:49.901639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:37:49.901639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aade165c-bc0d-4b1d-9d9e-2f7aced9a29e could not be found. May 13 17:37:49.901639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:37:49.901639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:37:49.901639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:37:49.901639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:37:49.901639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:37:49.901639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:37:49.901639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:37:49.901639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:37:49.901639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aade165c-bc0d-4b1d-9d9e-2f7aced9a29e could not be found. May 13 17:37:49.901639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:37:49.903148 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-44caf6fc-02b5-450f-ade3-1484ac52cb23 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Returning 404 to user: Instance aade165c-bc0d-4b1d-9d9e-2f7aced9a29e could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:37:49.903148 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-44caf6fc-02b5-450f-ade3-1484ac52cb23 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e" status: 404 len: 111 microversion: 2.1 time: 0.029127 May 13 17:37:49.903148 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 704/1390] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:49 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:37:49.906449 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-529cad0e-02f6-4708-86ca-cc1829eed7b3 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '.version_select at 0x7fa08496f1f0>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:50.001514 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-529cad0e-02f6-4708-86ca-cc1829eed7b3 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-142637754" status: 202 len: 0 microversion: 2.1 time: 0.098903 May 13 17:37:50.002122 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 687/1391] 10.222.0.64 () {58 vars in 1217 bytes} [Fri May 13 17:37:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-142637754 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:37:53.204469 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-da61ac10-4b0f-48a1-9672-765ad1193fdf tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:53.204970 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-da61ac10-4b0f-48a1-9672-765ad1193fdf tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:53.212015 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-da61ac10-4b0f-48a1-9672-765ad1193fdf tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:53.212466 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-da61ac10-4b0f-48a1-9672-765ad1193fdf tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:53.213279 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-da61ac10-4b0f-48a1-9672-765ad1193fdf tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:53.213717 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-da61ac10-4b0f-48a1-9672-765ad1193fdf tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:53.227320 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-da61ac10-4b0f-48a1-9672-765ad1193fdf tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] HTTP exception thrown: Instance aade165c-bc0d-4b1d-9d9e-2f7aced9a29e could not be found. May 13 17:37:53.229104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-da61ac10-4b0f-48a1-9672-765ad1193fdf tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Request method failure captured: May 13 17:37:53.229104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: DELETE /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e HTTP/1.1 May 13 17:37:53.229104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:37:53.229104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:37:53.229104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:37:53.229104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:37:53.229104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:37:53.229104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:37:53.229104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:37:53.229104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:37:53.229104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpTdLnBC38r4Fsk9gF4Q-qgew3N3xjHhysfU0GZ-tBIod1vsC397_Sdc9w8yS8dTL3JtngECr8kriEYGXb2K57w2zELiJFXMiTm7t-oES09p5xGMFJ4DBpSXhYJTVYXQuAVegMjasycGrLXLNpygd-WetdBy4ZYTGGIVOgqJHlQUF5Y May 13 17:37:53.229104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:37:53.229104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:37:53.229104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:37:53.229104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:37:53.229104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:37:53.229104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:37:53.229104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: f8e7b818f3a74fc48f0faeeb3398069a May 13 17:37:53.229104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-AttachVolumeTestJSON-878348621 May 13 17:37:53.229104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:37:53.229104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:37:53.230639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f8e7b818f3a74fc48f0faeeb3398069a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f8e7b818f3a74fc48f0faeeb3398069a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f8e7b818f3a74fc48f0faeeb3398069a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f8e7b818f3a74fc48f0faeeb3398069a"}]}] May 13 17:37:53.230639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-AttachVolumeTestJSON-878348621 May 13 17:37:53.230639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: f8e7b818f3a74fc48f0faeeb3398069a May 13 17:37:53.230639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-AttachVolumeTestJSON-878348621 May 13 17:37:53.230639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-AttachVolumeTestJSON-878348621-project May 13 17:37:53.230639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:37:53.230639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:37:53.230639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: efc23cbdbebc423baed1a2cb6c6cd7e7 May 13 17:37:53.230639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-AttachVolumeTestJSON-878348621-project May 13 17:37:53.230639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: > May 13 17:37:53.230639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Instance aade165c-bc0d-4b1d-9d9e-2f7aced9a29e could not be found. May 13 17:37:53.230639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'id': 'aade165c-bc0d-4b1d-9d9e-2f7aced9a29e'} May 13 17:37:53.231527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:37:53.231527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:37:53.231527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:37:53.231527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:37:53.231527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:37:53.231527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:37:53.231527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:37:53.231527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:37:53.231527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:37:53.231527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:37:53.231527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aade165c-bc0d-4b1d-9d9e-2f7aced9a29e could not be found. May 13 17:37:53.231527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:37:53.231527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:37:53.231527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:37:53.231527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:37:53.231527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:37:53.231527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:37:53.231527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:37:53.231527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:37:53.231527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:37:53.233115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:37:53.233115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 17:37:53.233115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 17:37:53.233115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 17:37:53.233115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 17:37:53.233115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:37:53.233115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:37:53.233115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:37:53.233115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:37:53.233115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aade165c-bc0d-4b1d-9d9e-2f7aced9a29e could not be found. May 13 17:37:53.233115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:37:53.233115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:37:53.233115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:37:53.233115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:37:53.233115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:37:53.233115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:37:53.233115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:37:53.233115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:37:53.233115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aade165c-bc0d-4b1d-9d9e-2f7aced9a29e could not be found. May 13 17:37:53.233115 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:37:53.234570 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-da61ac10-4b0f-48a1-9672-765ad1193fdf tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Returning 404 to user: Instance aade165c-bc0d-4b1d-9d9e-2f7aced9a29e could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:37:53.234570 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-da61ac10-4b0f-48a1-9672-765ad1193fdf tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "DELETE /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e" status: 404 len: 111 microversion: 2.1 time: 0.029908 May 13 17:37:53.234570 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 705/1392] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:37:53 2022] DELETE /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:37:53.239176 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-9c1f0232-2730-4e5c-a18e-ff68c90d21e9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:53.239891 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-9c1f0232-2730-4e5c-a18e-ff68c90d21e9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: aade165c-bc0d-4b1d-9d9e-2f7aced9a29e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:53.246693 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9c1f0232-2730-4e5c-a18e-ff68c90d21e9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:53.247182 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9c1f0232-2730-4e5c-a18e-ff68c90d21e9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:53.247918 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9c1f0232-2730-4e5c-a18e-ff68c90d21e9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:53.248354 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9c1f0232-2730-4e5c-a18e-ff68c90d21e9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:53.261622 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-9c1f0232-2730-4e5c-a18e-ff68c90d21e9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] HTTP exception thrown: Instance aade165c-bc0d-4b1d-9d9e-2f7aced9a29e could not be found. May 13 17:37:53.263261 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-9c1f0232-2730-4e5c-a18e-ff68c90d21e9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Request method failure captured: May 13 17:37:53.263261 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e HTTP/1.1 May 13 17:37:53.263261 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:37:53.263261 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:37:53.263261 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:37:53.263261 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 0 May 13 17:37:53.263261 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:37:53.263261 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:37:53.263261 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:37:53.263261 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:37:53.263261 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpTdLnBC38r4Fsk9gF4Q-qgew3N3xjHhysfU0GZ-tBIod1vsC397_Sdc9w8yS8dTL3JtngECr8kriEYGXb2K57w2zELiJFXMiTm7t-oES09p5xGMFJ4DBpSXhYJTVYXQuAVegMjasycGrLXLNpygd-WetdBy4ZYTGGIVOgqJHlQUF5Y May 13 17:37:53.263261 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:37:53.263261 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:37:53.263261 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:37:53.263261 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:37:53.263261 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:37:53.263261 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:37:53.263261 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: f8e7b818f3a74fc48f0faeeb3398069a May 13 17:37:53.263261 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-AttachVolumeTestJSON-878348621 May 13 17:37:53.263261 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:37:53.263261 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:37:53.264828 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f8e7b818f3a74fc48f0faeeb3398069a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f8e7b818f3a74fc48f0faeeb3398069a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f8e7b818f3a74fc48f0faeeb3398069a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f8e7b818f3a74fc48f0faeeb3398069a"}]}] May 13 17:37:53.264828 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-AttachVolumeTestJSON-878348621 May 13 17:37:53.264828 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: f8e7b818f3a74fc48f0faeeb3398069a May 13 17:37:53.264828 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-AttachVolumeTestJSON-878348621 May 13 17:37:53.264828 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-AttachVolumeTestJSON-878348621-project May 13 17:37:53.264828 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:37:53.264828 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:37:53.264828 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: efc23cbdbebc423baed1a2cb6c6cd7e7 May 13 17:37:53.264828 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-AttachVolumeTestJSON-878348621-project May 13 17:37:53.264828 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: > May 13 17:37:53.264828 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Instance aade165c-bc0d-4b1d-9d9e-2f7aced9a29e could not be found. May 13 17:37:53.264828 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'id': 'aade165c-bc0d-4b1d-9d9e-2f7aced9a29e'} May 13 17:37:53.265719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:37:53.265719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:37:53.265719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:37:53.265719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:37:53.265719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:37:53.265719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:37:53.265719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:37:53.265719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:37:53.265719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:37:53.265719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:37:53.265719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aade165c-bc0d-4b1d-9d9e-2f7aced9a29e could not be found. May 13 17:37:53.265719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:37:53.265719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:37:53.265719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:37:53.265719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:37:53.265719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:37:53.265719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:37:53.265719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:37:53.265719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:37:53.265719 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:37:53.267299 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:37:53.267299 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:37:53.267299 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:37:53.267299 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:37:53.267299 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:37:53.267299 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:37:53.267299 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:37:53.267299 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aade165c-bc0d-4b1d-9d9e-2f7aced9a29e could not be found. May 13 17:37:53.267299 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:37:53.267299 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:37:53.267299 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:37:53.267299 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:37:53.267299 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:37:53.267299 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:37:53.267299 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:37:53.267299 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:37:53.267299 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aade165c-bc0d-4b1d-9d9e-2f7aced9a29e could not be found. May 13 17:37:53.267299 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:37:53.268889 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-9c1f0232-2730-4e5c-a18e-ff68c90d21e9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Returning 404 to user: Instance aade165c-bc0d-4b1d-9d9e-2f7aced9a29e could not be found. {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:37:53.268889 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-9c1f0232-2730-4e5c-a18e-ff68c90d21e9 tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e" status: 404 len: 111 microversion: 2.1 time: 0.029755 May 13 17:37:53.268889 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 688/1393] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:53 2022] GET /compute/v2.1/servers/aade165c-bc0d-4b1d-9d9e-2f7aced9a29e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:37:54.535933 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-22a46221-52f9-4362-a8b6-2c1dfbc31c0d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:54.536452 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-22a46221-52f9-4362-a8b6-2c1dfbc31c0d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:54.543195 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-22a46221-52f9-4362-a8b6-2c1dfbc31c0d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:54.543652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-22a46221-52f9-4362-a8b6-2c1dfbc31c0d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:54.544426 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-22a46221-52f9-4362-a8b6-2c1dfbc31c0d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:54.544863 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-22a46221-52f9-4362-a8b6-2c1dfbc31c0d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:54.558736 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-22a46221-52f9-4362-a8b6-2c1dfbc31c0d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] HTTP exception thrown: Instance 9a72fdd8-ca24-4ae1-b007-7e22f411ad48 could not be found. May 13 17:37:54.560314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-22a46221-52f9-4362-a8b6-2c1dfbc31c0d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Request method failure captured: May 13 17:37:54.560314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: DELETE /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 HTTP/1.1 May 13 17:37:54.560314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:37:54.560314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:37:54.560314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:37:54.560314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:37:54.560314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:37:54.560314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:37:54.560314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:37:54.560314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:37:54.560314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpTdLnBC38r4Fsk9gF4Q-qgew3N3xjHhysfU0GZ-tBIod1vsC397_Sdc9w8yS8dTL3JtngECr8kriEYGXb2K57w2zELiJFXMiTm7t-oES09p5xGMFJ4DBpSXhYJTVYXQuAVegMjasycGrLXLNpygd-WetdBy4ZYTGGIVOgqJHlQUF5Y May 13 17:37:54.560314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:37:54.560314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:37:54.560314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:37:54.560314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:37:54.560314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:37:54.560314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:37:54.560314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: f8e7b818f3a74fc48f0faeeb3398069a May 13 17:37:54.560314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-AttachVolumeTestJSON-878348621 May 13 17:37:54.560314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:37:54.560314 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:37:54.561870 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f8e7b818f3a74fc48f0faeeb3398069a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f8e7b818f3a74fc48f0faeeb3398069a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f8e7b818f3a74fc48f0faeeb3398069a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f8e7b818f3a74fc48f0faeeb3398069a"}]}] May 13 17:37:54.561870 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-AttachVolumeTestJSON-878348621 May 13 17:37:54.561870 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: f8e7b818f3a74fc48f0faeeb3398069a May 13 17:37:54.561870 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-AttachVolumeTestJSON-878348621 May 13 17:37:54.561870 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-AttachVolumeTestJSON-878348621-project May 13 17:37:54.561870 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:37:54.561870 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:37:54.561870 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: efc23cbdbebc423baed1a2cb6c6cd7e7 May 13 17:37:54.561870 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-AttachVolumeTestJSON-878348621-project May 13 17:37:54.561870 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: > May 13 17:37:54.561870 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Instance 9a72fdd8-ca24-4ae1-b007-7e22f411ad48 could not be found. May 13 17:37:54.561870 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '9a72fdd8-ca24-4ae1-b007-7e22f411ad48'} May 13 17:37:54.562753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:37:54.562753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:37:54.562753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:37:54.562753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:37:54.562753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:37:54.562753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:37:54.562753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:37:54.562753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:37:54.562753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:37:54.562753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:37:54.562753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a72fdd8-ca24-4ae1-b007-7e22f411ad48 could not be found. May 13 17:37:54.562753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:37:54.562753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:37:54.562753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:37:54.562753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:37:54.562753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:37:54.562753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:37:54.562753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:37:54.562753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:37:54.562753 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:37:54.564398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:37:54.564398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 17:37:54.564398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 17:37:54.564398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 17:37:54.564398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 17:37:54.564398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:37:54.564398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:37:54.564398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:37:54.564398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:37:54.564398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a72fdd8-ca24-4ae1-b007-7e22f411ad48 could not be found. May 13 17:37:54.564398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:37:54.564398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:37:54.564398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:37:54.564398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:37:54.564398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:37:54.564398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:37:54.564398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:37:54.564398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:37:54.564398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a72fdd8-ca24-4ae1-b007-7e22f411ad48 could not be found. May 13 17:37:54.564398 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:37:54.566074 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-22a46221-52f9-4362-a8b6-2c1dfbc31c0d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Returning 404 to user: Instance 9a72fdd8-ca24-4ae1-b007-7e22f411ad48 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:37:54.566074 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-22a46221-52f9-4362-a8b6-2c1dfbc31c0d tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "DELETE /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 404 len: 111 microversion: 2.1 time: 0.029655 May 13 17:37:54.566074 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 706/1394] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:37:54 2022] DELETE /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:37:54.569866 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-519ca480-dbbf-4845-9c36-e5869521148b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:37:54.570500 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-519ca480-dbbf-4845-9c36-e5869521148b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] [instance: 9a72fdd8-ca24-4ae1-b007-7e22f411ad48] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:37:54.576854 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-519ca480-dbbf-4845-9c36-e5869521148b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:54.577315 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-519ca480-dbbf-4845-9c36-e5869521148b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:54.578088 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-519ca480-dbbf-4845-9c36-e5869521148b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:37:54.578530 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-519ca480-dbbf-4845-9c36-e5869521148b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:37:54.591764 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-519ca480-dbbf-4845-9c36-e5869521148b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] HTTP exception thrown: Instance 9a72fdd8-ca24-4ae1-b007-7e22f411ad48 could not be found. May 13 17:37:54.593280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-519ca480-dbbf-4845-9c36-e5869521148b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Request method failure captured: May 13 17:37:54.593280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 HTTP/1.1 May 13 17:37:54.593280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:37:54.593280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:37:54.593280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:37:54.593280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 0 May 13 17:37:54.593280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:37:54.593280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:37:54.593280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:37:54.593280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:37:54.593280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpTdLnBC38r4Fsk9gF4Q-qgew3N3xjHhysfU0GZ-tBIod1vsC397_Sdc9w8yS8dTL3JtngECr8kriEYGXb2K57w2zELiJFXMiTm7t-oES09p5xGMFJ4DBpSXhYJTVYXQuAVegMjasycGrLXLNpygd-WetdBy4ZYTGGIVOgqJHlQUF5Y May 13 17:37:54.593280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:37:54.593280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:37:54.593280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:37:54.593280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:37:54.593280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:37:54.593280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:37:54.593280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: f8e7b818f3a74fc48f0faeeb3398069a May 13 17:37:54.593280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-AttachVolumeTestJSON-878348621 May 13 17:37:54.593280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:37:54.593280 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:37:54.594888 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f8e7b818f3a74fc48f0faeeb3398069a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f8e7b818f3a74fc48f0faeeb3398069a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f8e7b818f3a74fc48f0faeeb3398069a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f8e7b818f3a74fc48f0faeeb3398069a"}]}] May 13 17:37:54.594888 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-AttachVolumeTestJSON-878348621 May 13 17:37:54.594888 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: f8e7b818f3a74fc48f0faeeb3398069a May 13 17:37:54.594888 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-AttachVolumeTestJSON-878348621 May 13 17:37:54.594888 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-AttachVolumeTestJSON-878348621-project May 13 17:37:54.594888 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:37:54.594888 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:37:54.594888 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: efc23cbdbebc423baed1a2cb6c6cd7e7 May 13 17:37:54.594888 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-AttachVolumeTestJSON-878348621-project May 13 17:37:54.594888 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: > May 13 17:37:54.594888 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Instance 9a72fdd8-ca24-4ae1-b007-7e22f411ad48 could not be found. May 13 17:37:54.594888 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'id': '9a72fdd8-ca24-4ae1-b007-7e22f411ad48'} May 13 17:37:54.595919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:37:54.595919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:37:54.595919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:37:54.595919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:37:54.595919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:37:54.595919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:37:54.595919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:37:54.595919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:37:54.595919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:37:54.595919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:37:54.595919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a72fdd8-ca24-4ae1-b007-7e22f411ad48 could not be found. May 13 17:37:54.595919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:37:54.595919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:37:54.595919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:37:54.595919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:37:54.595919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:37:54.595919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:37:54.595919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:37:54.595919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:37:54.595919 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:37:54.597403 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:37:54.597403 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:37:54.597403 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:37:54.597403 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:37:54.597403 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:37:54.597403 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:37:54.597403 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:37:54.597403 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a72fdd8-ca24-4ae1-b007-7e22f411ad48 could not be found. May 13 17:37:54.597403 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:37:54.597403 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:37:54.597403 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:37:54.597403 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:37:54.597403 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:37:54.597403 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:37:54.597403 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:37:54.597403 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:37:54.597403 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a72fdd8-ca24-4ae1-b007-7e22f411ad48 could not be found. May 13 17:37:54.597403 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:37:54.598980 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-519ca480-dbbf-4845-9c36-e5869521148b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] Returning 404 to user: Instance 9a72fdd8-ca24-4ae1-b007-7e22f411ad48 could not be found. {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:37:54.598980 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-519ca480-dbbf-4845-9c36-e5869521148b tempest-AttachVolumeTestJSON-878348621 tempest-AttachVolumeTestJSON-878348621-project] 10.222.0.64 "GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48" status: 404 len: 111 microversion: 2.1 time: 0.028615 May 13 17:37:54.598980 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 689/1395] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:37:54 2022] GET /compute/v2.1/servers/9a72fdd8-ca24-4ae1-b007-7e22f411ad48 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 13 17:38:06.071845 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7d57cd38-9e85-40f9-80d5-b754e4802503 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:06.072416 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7d57cd38-9e85-40f9-80d5-b754e4802503 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:06.078626 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7d57cd38-9e85-40f9-80d5-b754e4802503 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:06.079081 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7d57cd38-9e85-40f9-80d5-b754e4802503 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:06.079879 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7d57cd38-9e85-40f9-80d5-b754e4802503 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:06.080322 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7d57cd38-9e85-40f9-80d5-b754e4802503 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:06.104649 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7d57cd38-9e85-40f9-80d5-b754e4802503 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504/ips" status: 200 len: 151 microversion: 2.1 time: 0.036707 May 13 17:38:06.105212 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 707/1396] 10.222.0.64 () {58 vars in 1247 bytes} [Fri May 13 17:38:06 2022] GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504/ips => generated 151 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:38:08.741771 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-8050e3db-7d05-4524-bac4-bb5b7e9d0187 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "38db11f0-ebc8-42ea-8bc0-47e4f00619ae"}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:38:08.742873 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-8050e3db-7d05-4524-bac4-bb5b7e9d0187 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:08.749610 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8050e3db-7d05-4524-bac4-bb5b7e9d0187 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:08.750065 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8050e3db-7d05-4524-bac4-bb5b7e9d0187 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:08.750837 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8050e3db-7d05-4524-bac4-bb5b7e9d0187 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:08.751322 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-8050e3db-7d05-4524-bac4-bb5b7e9d0187 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:09.375595 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-8050e3db-7d05-4524-bac4-bb5b7e9d0187 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "POST /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.637333 May 13 17:38:09.380223 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 690/1397] 10.222.0.64 () {60 vars in 1322 bytes} [Fri May 13 17:38:08 2022] POST /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504/os-volume_attachments => generated 194 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:38:18.016208 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-299cd040-257e-455b-a144-7542e3858b8b tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:18.016696 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-299cd040-257e-455b-a144-7542e3858b8b tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:18.023308 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-299cd040-257e-455b-a144-7542e3858b8b tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:18.023754 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-299cd040-257e-455b-a144-7542e3858b8b tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:18.024510 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-299cd040-257e-455b-a144-7542e3858b8b tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:18.024940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-299cd040-257e-455b-a144-7542e3858b8b tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:18.103805 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-299cd040-257e-455b-a144-7542e3858b8b tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lazy-loading 'services' on Instance uuid e3946add-9fd1-4b68-815a-b2f91ff85504 {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:38:18.319629 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-299cd040-257e-455b-a144-7542e3858b8b tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504/os-volume_attachments/38db11f0-ebc8-42ea-8bc0-47e4f00619ae" status: 202 len: 0 microversion: 2.1 time: 0.306770 May 13 17:38:18.320156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 708/1398] 10.222.0.64 () {58 vars in 1415 bytes} [Fri May 13 17:38:18 2022] DELETE /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504/os-volume_attachments/38db11f0-ebc8-42ea-8bc0-47e4f00619ae => generated 0 bytes in 308 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:38:18.329714 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b8c929f3-a926-4b85-a2e0-6655a2462349 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:18.330728 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b8c929f3-a926-4b85-a2e0-6655a2462349 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:18.336892 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b8c929f3-a926-4b85-a2e0-6655a2462349 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:18.337345 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b8c929f3-a926-4b85-a2e0-6655a2462349 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:18.338125 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b8c929f3-a926-4b85-a2e0-6655a2462349 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:18.338567 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b8c929f3-a926-4b85-a2e0-6655a2462349 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:18.367809 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b8c929f3-a926-4b85-a2e0-6655a2462349 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043036 May 13 17:38:18.368370 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 691/1399] 10.222.0.64 () {58 vars in 1301 bytes} [Fri May 13 17:38:18 2022] GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:38:19.380140 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-3c8fe6af-a442-41e8-85b6-1fb4013eeaf7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:19.381171 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-3c8fe6af-a442-41e8-85b6-1fb4013eeaf7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:19.387642 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3c8fe6af-a442-41e8-85b6-1fb4013eeaf7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:19.388099 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3c8fe6af-a442-41e8-85b6-1fb4013eeaf7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:19.388874 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3c8fe6af-a442-41e8-85b6-1fb4013eeaf7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:19.389319 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-3c8fe6af-a442-41e8-85b6-1fb4013eeaf7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:19.418752 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-3c8fe6af-a442-41e8-85b6-1fb4013eeaf7 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043413 May 13 17:38:19.419338 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 709/1400] 10.222.0.64 () {58 vars in 1301 bytes} [Fri May 13 17:38:19 2022] GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:38:20.430043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a6f148ed-914f-473c-83f5-866141d2500d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:20.430894 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a6f148ed-914f-473c-83f5-866141d2500d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:20.437147 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a6f148ed-914f-473c-83f5-866141d2500d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:20.437601 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a6f148ed-914f-473c-83f5-866141d2500d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:20.438374 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a6f148ed-914f-473c-83f5-866141d2500d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:20.438810 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a6f148ed-914f-473c-83f5-866141d2500d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:20.472508 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a6f148ed-914f-473c-83f5-866141d2500d tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046514 May 13 17:38:20.473100 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 692/1401] 10.222.0.64 () {58 vars in 1301 bytes} [Fri May 13 17:38:20 2022] GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 13 17:38:20.527873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-fb5e3e37-fac4-4a85-979c-fdf04e706755 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:20.528403 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fb5e3e37-fac4-4a85-979c-fdf04e706755 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:20.535326 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fb5e3e37-fac4-4a85-979c-fdf04e706755 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:20.535777 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fb5e3e37-fac4-4a85-979c-fdf04e706755 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:20.536538 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fb5e3e37-fac4-4a85-979c-fdf04e706755 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:20.536975 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-fb5e3e37-fac4-4a85-979c-fdf04e706755 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:20.561034 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-fb5e3e37-fac4-4a85-979c-fdf04e706755 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Going to try to terminate instance {{(pid=117493) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 17:38:20.805423 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-fb5e3e37-fac4-4a85-979c-fdf04e706755 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504" status: 204 len: 0 microversion: 2.1 time: 0.281017 May 13 17:38:20.805994 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 710/1402] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:38:20 2022] DELETE /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 17:38:20.814093 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-1c3bdef1-2900-45cd-a621-a6c36c5f0766 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:20.814749 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-1c3bdef1-2900-45cd-a621-a6c36c5f0766 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:20.820798 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1c3bdef1-2900-45cd-a621-a6c36c5f0766 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:20.821248 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1c3bdef1-2900-45cd-a621-a6c36c5f0766 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:20.822616 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1c3bdef1-2900-45cd-a621-a6c36c5f0766 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:20.823327 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-1c3bdef1-2900-45cd-a621-a6c36c5f0766 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:20.953627 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-1c3bdef1-2900-45cd-a621-a6c36c5f0766 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:20.961553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-1c3bdef1-2900-45cd-a621-a6c36c5f0766 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504" status: 200 len: 1682 microversion: 2.1 time: 0.151389 May 13 17:38:20.962118 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 693/1403] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:20 2022] GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504 => generated 1682 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:38:21.978568 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a3c1a1fb-09b5-4e4b-b940-2f8c8f25461e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:21.979555 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a3c1a1fb-09b5-4e4b-b940-2f8c8f25461e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:21.985869 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a3c1a1fb-09b5-4e4b-b940-2f8c8f25461e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:21.986322 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a3c1a1fb-09b5-4e4b-b940-2f8c8f25461e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:21.987093 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a3c1a1fb-09b5-4e4b-b940-2f8c8f25461e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:21.987558 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a3c1a1fb-09b5-4e4b-b940-2f8c8f25461e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:22.113872 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-a3c1a1fb-09b5-4e4b-b940-2f8c8f25461e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:22.121425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a3c1a1fb-09b5-4e4b-b940-2f8c8f25461e tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504" status: 200 len: 1682 microversion: 2.1 time: 0.147116 May 13 17:38:22.122015 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 711/1404] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:21 2022] GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504 => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:38:23.140188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-27eb81ad-2759-4deb-ad5c-fde50f4eefd5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:23.140794 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-27eb81ad-2759-4deb-ad5c-fde50f4eefd5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:23.147809 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-27eb81ad-2759-4deb-ad5c-fde50f4eefd5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:23.148258 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-27eb81ad-2759-4deb-ad5c-fde50f4eefd5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:23.149015 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-27eb81ad-2759-4deb-ad5c-fde50f4eefd5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:23.149449 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-27eb81ad-2759-4deb-ad5c-fde50f4eefd5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:23.272687 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-27eb81ad-2759-4deb-ad5c-fde50f4eefd5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:23.280018 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-27eb81ad-2759-4deb-ad5c-fde50f4eefd5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504" status: 200 len: 1682 microversion: 2.1 time: 0.143714 May 13 17:38:23.280596 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 694/1405] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:23 2022] GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504 => generated 1682 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:38:24.296494 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-f6e017bb-7b38-4d89-b63a-ac7f67fd4b7f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:24.297105 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-f6e017bb-7b38-4d89-b63a-ac7f67fd4b7f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:24.304540 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f6e017bb-7b38-4d89-b63a-ac7f67fd4b7f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:24.305000 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f6e017bb-7b38-4d89-b63a-ac7f67fd4b7f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:24.305792 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f6e017bb-7b38-4d89-b63a-ac7f67fd4b7f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:24.306236 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-f6e017bb-7b38-4d89-b63a-ac7f67fd4b7f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:24.577377 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-f6e017bb-7b38-4d89-b63a-ac7f67fd4b7f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfc52b61bcf845d1953a5a111abb3666', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae7b37b41d944427945d783a460ca12a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:24.585324 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-f6e017bb-7b38-4d89-b63a-ac7f67fd4b7f tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504" status: 200 len: 1614 microversion: 2.1 time: 0.292705 May 13 17:38:24.586000 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 712/1406] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:24 2022] GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504 => generated 1614 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:38:24.642751 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-f5e07ef6-622d-4f89-b0bf-f2b6e0781081 req-09c01f87-f1d8-4cac-8df9-9391d2f1798b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3946add-9fd1-4b68-815a-b2f91ff85504", "name": "network-vif-deleted", "tag": "3f4c19e6-a6aa-42e2-8c1b-98a74f543196"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:38:24.651412 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-f5e07ef6-622d-4f89-b0bf-f2b6e0781081 req-09c01f87-f1d8-4cac-8df9-9391d2f1798b service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:24.651862 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-f5e07ef6-622d-4f89-b0bf-f2b6e0781081 req-09c01f87-f1d8-4cac-8df9-9391d2f1798b service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:24.665069 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-f5e07ef6-622d-4f89-b0bf-f2b6e0781081 req-09c01f87-f1d8-4cac-8df9-9391d2f1798b service nova] Creating event network-vif-deleted:3f4c19e6-a6aa-42e2-8c1b-98a74f543196 for instance e3946add-9fd1-4b68-815a-b2f91ff85504 on hv-cinder-84178 May 13 17:38:24.669980 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-f5e07ef6-622d-4f89-b0bf-f2b6e0781081 req-09c01f87-f1d8-4cac-8df9-9391d2f1798b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031015 May 13 17:38:24.670579 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 695/1407] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:38:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:38:25.602329 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ff5a1b40-1e20-43bf-882d-13f31815fbbc tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:25.603068 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ff5a1b40-1e20-43bf-882d-13f31815fbbc tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:25.609975 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ff5a1b40-1e20-43bf-882d-13f31815fbbc tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:25.610532 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ff5a1b40-1e20-43bf-882d-13f31815fbbc tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:25.611363 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ff5a1b40-1e20-43bf-882d-13f31815fbbc tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:25.612343 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ff5a1b40-1e20-43bf-882d-13f31815fbbc tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:25.626071 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-ff5a1b40-1e20-43bf-882d-13f31815fbbc tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] HTTP exception thrown: Instance e3946add-9fd1-4b68-815a-b2f91ff85504 could not be found. May 13 17:38:25.628339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ff5a1b40-1e20-43bf-882d-13f31815fbbc tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Request method failure captured: May 13 17:38:25.628339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504 HTTP/1.1 May 13 17:38:25.628339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:38:25.628339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:38:25.628339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:38:25.628339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:38:25.628339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:38:25.628339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:38:25.628339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:38:25.628339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:38:25.628339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpTc_RrVmxy2iGzrfQJ2JGoLflGoXwQ8zHwIs9aTMpqZXeC78NlpwKZWhCbBdWoUAU_vvb08rrsxX0JsiGqFmgTgDrNVuDQuL1AnwToYH23sqxxCURxc3AiIzkc2Y-1ZSXLpS2OklBXtojTSGTsLp1Uq6KzyDltfns2DlgjWoGsxMc0 May 13 17:38:25.628339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:38:25.628339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:38:25.628339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:38:25.628339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:38:25.628339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:38:25.628339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:38:25.628339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: ae7b37b41d944427945d783a460ca12a May 13 17:38:25.628339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:25.628339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:38:25.628339 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:38:25.629854 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ae7b37b41d944427945d783a460ca12a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}] May 13 17:38:25.629854 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:25.629854 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: ae7b37b41d944427945d783a460ca12a May 13 17:38:25.629854 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:25.629854 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:38:25.629854 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:38:25.629854 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:38:25.629854 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: dfc52b61bcf845d1953a5a111abb3666 May 13 17:38:25.629854 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:38:25.629854 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: > May 13 17:38:25.629854 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Instance e3946add-9fd1-4b68-815a-b2f91ff85504 could not be found. May 13 17:38:25.629854 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'id': 'e3946add-9fd1-4b68-815a-b2f91ff85504'} May 13 17:38:25.630716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:38:25.630716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:25.630716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:38:25.630716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:38:25.630716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:38:25.630716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:38:25.630716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:38:25.630716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:38:25.630716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:38:25.630716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:38:25.630716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3946add-9fd1-4b68-815a-b2f91ff85504 could not be found. May 13 17:38:25.630716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:25.630716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:25.630716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:25.630716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:25.630716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:25.630716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:25.630716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:38:25.630716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:38:25.630716 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:38:25.637190 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:38:25.637190 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:38:25.637190 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:38:25.637190 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:38:25.637190 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:38:25.637190 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:38:25.637190 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:38:25.637190 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3946add-9fd1-4b68-815a-b2f91ff85504 could not be found. May 13 17:38:25.637190 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:25.637190 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:25.637190 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:25.637190 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:25.637190 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:25.637190 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:25.637190 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:38:25.637190 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:38:25.637190 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3946add-9fd1-4b68-815a-b2f91ff85504 could not be found. May 13 17:38:25.637190 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:25.638653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ff5a1b40-1e20-43bf-882d-13f31815fbbc tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Returning 404 to user: Instance e3946add-9fd1-4b68-815a-b2f91ff85504 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:38:25.638653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ff5a1b40-1e20-43bf-882d-13f31815fbbc tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504" status: 404 len: 111 microversion: 2.1 time: 0.031274 May 13 17:38:25.638653 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 713/1408] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:25 2022] GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:38:25.639103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-932a677b-5a03-4251-a98c-74dbf7adefa3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '.version_select at 0x7fa08490f1f0>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:25.715411 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-932a677b-5a03-4251-a98c-74dbf7adefa3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-86172652" status: 202 len: 0 microversion: 2.1 time: 0.080381 May 13 17:38:25.716319 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 696/1409] 10.222.0.64 () {58 vars in 1214 bytes} [Fri May 13 17:38:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-86172652 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:38:27.661370 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-50af9788-0f4a-4087-8f72-313fb911b4b3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:27.661885 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-50af9788-0f4a-4087-8f72-313fb911b4b3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:27.668102 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-50af9788-0f4a-4087-8f72-313fb911b4b3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:27.668558 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-50af9788-0f4a-4087-8f72-313fb911b4b3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:27.669320 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-50af9788-0f4a-4087-8f72-313fb911b4b3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:27.669755 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-50af9788-0f4a-4087-8f72-313fb911b4b3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:27.683361 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-50af9788-0f4a-4087-8f72-313fb911b4b3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] HTTP exception thrown: Instance e3946add-9fd1-4b68-815a-b2f91ff85504 could not be found. May 13 17:38:27.684875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-50af9788-0f4a-4087-8f72-313fb911b4b3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Request method failure captured: May 13 17:38:27.684875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: DELETE /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504 HTTP/1.1 May 13 17:38:27.684875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:38:27.684875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:38:27.684875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:38:27.684875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:38:27.684875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:38:27.684875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:38:27.684875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:38:27.684875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:38:27.684875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpTc_RrVmxy2iGzrfQJ2JGoLflGoXwQ8zHwIs9aTMpqZXeC78NlpwKZWhCbBdWoUAU_vvb08rrsxX0JsiGqFmgTgDrNVuDQuL1AnwToYH23sqxxCURxc3AiIzkc2Y-1ZSXLpS2OklBXtojTSGTsLp1Uq6KzyDltfns2DlgjWoGsxMc0 May 13 17:38:27.684875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:38:27.684875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:38:27.684875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:38:27.684875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:38:27.684875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:38:27.684875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:38:27.684875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: ae7b37b41d944427945d783a460ca12a May 13 17:38:27.684875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:27.684875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:38:27.684875 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:38:27.686431 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ae7b37b41d944427945d783a460ca12a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}] May 13 17:38:27.686431 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:27.686431 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: ae7b37b41d944427945d783a460ca12a May 13 17:38:27.686431 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:27.686431 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:38:27.686431 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:38:27.686431 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:38:27.686431 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: dfc52b61bcf845d1953a5a111abb3666 May 13 17:38:27.686431 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:38:27.686431 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: > May 13 17:38:27.686431 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Instance e3946add-9fd1-4b68-815a-b2f91ff85504 could not be found. May 13 17:38:27.686431 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'id': 'e3946add-9fd1-4b68-815a-b2f91ff85504'} May 13 17:38:27.687506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:38:27.687506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:27.687506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:38:27.687506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:38:27.687506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:38:27.687506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:38:27.687506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:38:27.687506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:38:27.687506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:38:27.687506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:38:27.687506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3946add-9fd1-4b68-815a-b2f91ff85504 could not be found. May 13 17:38:27.687506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:27.687506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:27.687506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:27.687506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:27.687506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:27.687506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:27.687506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:38:27.687506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:38:27.687506 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:38:27.689062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:38:27.689062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 17:38:27.689062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 17:38:27.689062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 17:38:27.689062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 17:38:27.689062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:38:27.689062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:38:27.689062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:38:27.689062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:38:27.689062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3946add-9fd1-4b68-815a-b2f91ff85504 could not be found. May 13 17:38:27.689062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:27.689062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:27.689062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:27.689062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:27.689062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:27.689062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:27.689062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:38:27.689062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:38:27.689062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3946add-9fd1-4b68-815a-b2f91ff85504 could not be found. May 13 17:38:27.689062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:27.690711 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-50af9788-0f4a-4087-8f72-313fb911b4b3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Returning 404 to user: Instance e3946add-9fd1-4b68-815a-b2f91ff85504 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:38:27.690711 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-50af9788-0f4a-4087-8f72-313fb911b4b3 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504" status: 404 len: 111 microversion: 2.1 time: 0.028849 May 13 17:38:27.690711 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 714/1410] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:38:27 2022] DELETE /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:38:27.696921 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-ef0553f3-dbc2-4c7e-9769-eb87d16a36b0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:27.697645 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-ef0553f3-dbc2-4c7e-9769-eb87d16a36b0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: e3946add-9fd1-4b68-815a-b2f91ff85504] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:27.704176 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ef0553f3-dbc2-4c7e-9769-eb87d16a36b0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:27.704618 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ef0553f3-dbc2-4c7e-9769-eb87d16a36b0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:27.705373 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ef0553f3-dbc2-4c7e-9769-eb87d16a36b0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:27.705805 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ef0553f3-dbc2-4c7e-9769-eb87d16a36b0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:27.719351 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-ef0553f3-dbc2-4c7e-9769-eb87d16a36b0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] HTTP exception thrown: Instance e3946add-9fd1-4b68-815a-b2f91ff85504 could not be found. May 13 17:38:27.721006 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-ef0553f3-dbc2-4c7e-9769-eb87d16a36b0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Request method failure captured: May 13 17:38:27.721006 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504 HTTP/1.1 May 13 17:38:27.721006 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:38:27.721006 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:38:27.721006 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:38:27.721006 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 0 May 13 17:38:27.721006 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:38:27.721006 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:38:27.721006 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:38:27.721006 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:38:27.721006 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpTc_RrVmxy2iGzrfQJ2JGoLflGoXwQ8zHwIs9aTMpqZXeC78NlpwKZWhCbBdWoUAU_vvb08rrsxX0JsiGqFmgTgDrNVuDQuL1AnwToYH23sqxxCURxc3AiIzkc2Y-1ZSXLpS2OklBXtojTSGTsLp1Uq6KzyDltfns2DlgjWoGsxMc0 May 13 17:38:27.721006 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:38:27.721006 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:38:27.721006 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:38:27.721006 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:38:27.721006 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:38:27.721006 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:38:27.721006 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: ae7b37b41d944427945d783a460ca12a May 13 17:38:27.721006 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:27.721006 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:38:27.721006 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:38:27.722409 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ae7b37b41d944427945d783a460ca12a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}] May 13 17:38:27.722409 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:27.722409 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: ae7b37b41d944427945d783a460ca12a May 13 17:38:27.722409 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:27.722409 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:38:27.722409 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:38:27.722409 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:38:27.722409 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: dfc52b61bcf845d1953a5a111abb3666 May 13 17:38:27.722409 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:38:27.722409 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: > May 13 17:38:27.722409 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Instance e3946add-9fd1-4b68-815a-b2f91ff85504 could not be found. May 13 17:38:27.722409 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'id': 'e3946add-9fd1-4b68-815a-b2f91ff85504'} May 13 17:38:27.723191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:38:27.723191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:27.723191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:38:27.723191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:38:27.723191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:38:27.723191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:38:27.723191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:38:27.723191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:38:27.723191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:38:27.723191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:38:27.723191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3946add-9fd1-4b68-815a-b2f91ff85504 could not be found. May 13 17:38:27.723191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:38:27.723191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:27.723191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:38:27.723191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:27.723191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:27.723191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:27.723191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:38:27.723191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:38:27.723191 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:38:27.724456 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:38:27.724456 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:38:27.724456 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:38:27.724456 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:38:27.724456 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:38:27.724456 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:38:27.724456 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:38:27.724456 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3946add-9fd1-4b68-815a-b2f91ff85504 could not be found. May 13 17:38:27.724456 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:38:27.724456 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:27.724456 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:38:27.724456 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:27.724456 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:27.724456 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:27.724456 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:38:27.724456 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:38:27.724456 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3946add-9fd1-4b68-815a-b2f91ff85504 could not be found. May 13 17:38:27.724456 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:38:27.725599 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-ef0553f3-dbc2-4c7e-9769-eb87d16a36b0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Returning 404 to user: Instance e3946add-9fd1-4b68-815a-b2f91ff85504 could not be found. {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:38:27.725599 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-ef0553f3-dbc2-4c7e-9769-eb87d16a36b0 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504" status: 404 len: 111 microversion: 2.1 time: 0.029830 May 13 17:38:27.725599 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 697/1411] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:27 2022] GET /compute/v2.1/servers/e3946add-9fd1-4b68-815a-b2f91ff85504 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:38:29.011345 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2b85f2ff-a23a-49b8-8a93-f1784aa79284 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:29.011846 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2b85f2ff-a23a-49b8-8a93-f1784aa79284 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:29.018179 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2b85f2ff-a23a-49b8-8a93-f1784aa79284 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:29.018646 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2b85f2ff-a23a-49b8-8a93-f1784aa79284 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:29.019427 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2b85f2ff-a23a-49b8-8a93-f1784aa79284 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:29.019866 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2b85f2ff-a23a-49b8-8a93-f1784aa79284 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:29.035094 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-2b85f2ff-a23a-49b8-8a93-f1784aa79284 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] HTTP exception thrown: Instance a8b767fd-1e8b-4b26-8c43-236c7698129e could not be found. May 13 17:38:29.037188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2b85f2ff-a23a-49b8-8a93-f1784aa79284 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Request method failure captured: May 13 17:38:29.037188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: DELETE /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e HTTP/1.1 May 13 17:38:29.037188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:38:29.037188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:38:29.037188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:38:29.037188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:38:29.037188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:38:29.037188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:38:29.037188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:38:29.037188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:38:29.037188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpTc_RrVmxy2iGzrfQJ2JGoLflGoXwQ8zHwIs9aTMpqZXeC78NlpwKZWhCbBdWoUAU_vvb08rrsxX0JsiGqFmgTgDrNVuDQuL1AnwToYH23sqxxCURxc3AiIzkc2Y-1ZSXLpS2OklBXtojTSGTsLp1Uq6KzyDltfns2DlgjWoGsxMc0 May 13 17:38:29.037188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:38:29.037188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:38:29.037188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:38:29.037188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:38:29.037188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:38:29.037188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:38:29.037188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: ae7b37b41d944427945d783a460ca12a May 13 17:38:29.037188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:29.037188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:38:29.037188 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:38:29.038764 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ae7b37b41d944427945d783a460ca12a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}] May 13 17:38:29.038764 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:29.038764 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: ae7b37b41d944427945d783a460ca12a May 13 17:38:29.038764 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:29.038764 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:38:29.038764 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:38:29.038764 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:38:29.038764 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: dfc52b61bcf845d1953a5a111abb3666 May 13 17:38:29.038764 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:38:29.038764 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: > May 13 17:38:29.038764 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Instance a8b767fd-1e8b-4b26-8c43-236c7698129e could not be found. May 13 17:38:29.038764 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'id': 'a8b767fd-1e8b-4b26-8c43-236c7698129e'} May 13 17:38:29.039893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:38:29.039893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:29.039893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:38:29.039893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:38:29.039893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:38:29.039893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:38:29.039893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:38:29.039893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:38:29.039893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:38:29.039893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:38:29.039893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8b767fd-1e8b-4b26-8c43-236c7698129e could not be found. May 13 17:38:29.039893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:29.039893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:29.039893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:29.039893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:29.039893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:29.039893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:29.039893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:38:29.039893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:38:29.039893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:38:29.041387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:38:29.041387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 17:38:29.041387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 17:38:29.041387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 17:38:29.041387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 17:38:29.041387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:38:29.041387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:38:29.041387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:38:29.041387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:38:29.041387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8b767fd-1e8b-4b26-8c43-236c7698129e could not be found. May 13 17:38:29.041387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:29.041387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:29.041387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:29.041387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:29.041387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:29.041387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:29.041387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:38:29.041387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:38:29.041387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8b767fd-1e8b-4b26-8c43-236c7698129e could not be found. May 13 17:38:29.041387 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:29.043191 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2b85f2ff-a23a-49b8-8a93-f1784aa79284 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Returning 404 to user: Instance a8b767fd-1e8b-4b26-8c43-236c7698129e could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:38:29.043191 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2b85f2ff-a23a-49b8-8a93-f1784aa79284 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e" status: 404 len: 111 microversion: 2.1 time: 0.031167 May 13 17:38:29.043191 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 715/1412] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:38:29 2022] DELETE /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:38:29.047418 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-47da2599-039d-417f-919d-282b02c1d557 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:29.048038 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-47da2599-039d-417f-919d-282b02c1d557 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: a8b767fd-1e8b-4b26-8c43-236c7698129e] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:29.055075 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-47da2599-039d-417f-919d-282b02c1d557 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:29.055565 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-47da2599-039d-417f-919d-282b02c1d557 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:29.056337 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-47da2599-039d-417f-919d-282b02c1d557 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:29.056778 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-47da2599-039d-417f-919d-282b02c1d557 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:29.070586 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-47da2599-039d-417f-919d-282b02c1d557 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] HTTP exception thrown: Instance a8b767fd-1e8b-4b26-8c43-236c7698129e could not be found. May 13 17:38:29.072188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-47da2599-039d-417f-919d-282b02c1d557 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Request method failure captured: May 13 17:38:29.072188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e HTTP/1.1 May 13 17:38:29.072188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:38:29.072188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:38:29.072188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:38:29.072188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 0 May 13 17:38:29.072188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:38:29.072188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:38:29.072188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:38:29.072188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:38:29.072188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpTc_RrVmxy2iGzrfQJ2JGoLflGoXwQ8zHwIs9aTMpqZXeC78NlpwKZWhCbBdWoUAU_vvb08rrsxX0JsiGqFmgTgDrNVuDQuL1AnwToYH23sqxxCURxc3AiIzkc2Y-1ZSXLpS2OklBXtojTSGTsLp1Uq6KzyDltfns2DlgjWoGsxMc0 May 13 17:38:29.072188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:38:29.072188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:38:29.072188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:38:29.072188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:38:29.072188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:38:29.072188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:38:29.072188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: ae7b37b41d944427945d783a460ca12a May 13 17:38:29.072188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:29.072188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:38:29.072188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:38:29.073799 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ae7b37b41d944427945d783a460ca12a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}] May 13 17:38:29.073799 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:29.073799 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: ae7b37b41d944427945d783a460ca12a May 13 17:38:29.073799 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:29.073799 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:38:29.073799 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:38:29.073799 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:38:29.073799 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: dfc52b61bcf845d1953a5a111abb3666 May 13 17:38:29.073799 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:38:29.073799 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: > May 13 17:38:29.073799 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Instance a8b767fd-1e8b-4b26-8c43-236c7698129e could not be found. May 13 17:38:29.073799 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'id': 'a8b767fd-1e8b-4b26-8c43-236c7698129e'} May 13 17:38:29.074758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:38:29.074758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:29.074758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:38:29.074758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:38:29.074758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:38:29.074758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:38:29.074758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:38:29.074758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:38:29.074758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:38:29.074758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:38:29.074758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8b767fd-1e8b-4b26-8c43-236c7698129e could not be found. May 13 17:38:29.074758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:38:29.074758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:29.074758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:38:29.074758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:29.074758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:29.074758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:29.074758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:38:29.074758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:38:29.074758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:38:29.076143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:38:29.076143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:38:29.076143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:38:29.076143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:38:29.076143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:38:29.076143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:38:29.076143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:38:29.076143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8b767fd-1e8b-4b26-8c43-236c7698129e could not be found. May 13 17:38:29.076143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:38:29.076143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:29.076143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:38:29.076143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:29.076143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:29.076143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:29.076143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:38:29.076143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:38:29.076143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8b767fd-1e8b-4b26-8c43-236c7698129e could not be found. May 13 17:38:29.076143 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:38:29.077350 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-47da2599-039d-417f-919d-282b02c1d557 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Returning 404 to user: Instance a8b767fd-1e8b-4b26-8c43-236c7698129e could not be found. {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:38:29.077350 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-47da2599-039d-417f-919d-282b02c1d557 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e" status: 404 len: 111 microversion: 2.1 time: 0.030248 May 13 17:38:29.077350 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 698/1413] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:29 2022] GET /compute/v2.1/servers/a8b767fd-1e8b-4b26-8c43-236c7698129e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:38:29.082123 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4690c5ab-a750-4027-b9db-297b9b90d6ed tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:29.082648 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4690c5ab-a750-4027-b9db-297b9b90d6ed tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:29.089368 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4690c5ab-a750-4027-b9db-297b9b90d6ed tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:29.089368 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4690c5ab-a750-4027-b9db-297b9b90d6ed tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:29.089846 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4690c5ab-a750-4027-b9db-297b9b90d6ed tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:29.090287 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4690c5ab-a750-4027-b9db-297b9b90d6ed tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:29.105070 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-4690c5ab-a750-4027-b9db-297b9b90d6ed tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] HTTP exception thrown: Instance 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 could not be found. May 13 17:38:29.106693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4690c5ab-a750-4027-b9db-297b9b90d6ed tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Request method failure captured: May 13 17:38:29.106693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: DELETE /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 HTTP/1.1 May 13 17:38:29.106693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:38:29.106693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:38:29.106693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:38:29.106693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:38:29.106693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:38:29.106693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:38:29.106693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:38:29.106693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:38:29.106693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpTc_RrVmxy2iGzrfQJ2JGoLflGoXwQ8zHwIs9aTMpqZXeC78NlpwKZWhCbBdWoUAU_vvb08rrsxX0JsiGqFmgTgDrNVuDQuL1AnwToYH23sqxxCURxc3AiIzkc2Y-1ZSXLpS2OklBXtojTSGTsLp1Uq6KzyDltfns2DlgjWoGsxMc0 May 13 17:38:29.106693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:38:29.106693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:38:29.106693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:38:29.106693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:38:29.106693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:38:29.106693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:38:29.106693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: ae7b37b41d944427945d783a460ca12a May 13 17:38:29.106693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:29.106693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:38:29.106693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:38:29.108626 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ae7b37b41d944427945d783a460ca12a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}] May 13 17:38:29.108626 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:29.108626 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: ae7b37b41d944427945d783a460ca12a May 13 17:38:29.108626 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:29.108626 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:38:29.108626 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:38:29.108626 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:38:29.108626 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: dfc52b61bcf845d1953a5a111abb3666 May 13 17:38:29.108626 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:38:29.108626 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: > May 13 17:38:29.108626 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Instance 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 could not be found. May 13 17:38:29.108626 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2'} May 13 17:38:29.109693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:38:29.109693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:29.109693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:38:29.109693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:38:29.109693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:38:29.109693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:38:29.109693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:38:29.109693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:38:29.109693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:38:29.109693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:38:29.109693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 could not be found. May 13 17:38:29.109693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:29.109693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:29.109693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:29.109693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:29.109693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:29.109693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:29.109693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:38:29.109693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:38:29.109693 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:38:29.112119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:38:29.112119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 17:38:29.112119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 17:38:29.112119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 17:38:29.112119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 17:38:29.112119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:38:29.112119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:38:29.112119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:38:29.112119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:38:29.112119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 could not be found. May 13 17:38:29.112119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:29.112119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:29.112119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:29.112119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:29.112119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:29.112119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:29.112119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:38:29.112119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:38:29.112119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 could not be found. May 13 17:38:29.112119 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:29.114507 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4690c5ab-a750-4027-b9db-297b9b90d6ed tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Returning 404 to user: Instance 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:38:29.114507 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4690c5ab-a750-4027-b9db-297b9b90d6ed tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "DELETE /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 404 len: 111 microversion: 2.1 time: 0.029975 May 13 17:38:29.114507 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 716/1414] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:38:29 2022] DELETE /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:38:29.119452 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-37fa0acf-0032-4202-9cbb-7d508432350c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:29.120131 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-37fa0acf-0032-4202-9cbb-7d508432350c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:29.126149 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-37fa0acf-0032-4202-9cbb-7d508432350c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:29.126602 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-37fa0acf-0032-4202-9cbb-7d508432350c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:29.127404 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-37fa0acf-0032-4202-9cbb-7d508432350c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:29.127845 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-37fa0acf-0032-4202-9cbb-7d508432350c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:29.150154 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-37fa0acf-0032-4202-9cbb-7d508432350c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] HTTP exception thrown: Instance 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 could not be found. May 13 17:38:29.151772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-37fa0acf-0032-4202-9cbb-7d508432350c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Request method failure captured: May 13 17:38:29.151772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 HTTP/1.1 May 13 17:38:29.151772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:38:29.151772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:38:29.151772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:38:29.151772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 0 May 13 17:38:29.151772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:38:29.151772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:38:29.151772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:38:29.151772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:38:29.151772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpTc_RrVmxy2iGzrfQJ2JGoLflGoXwQ8zHwIs9aTMpqZXeC78NlpwKZWhCbBdWoUAU_vvb08rrsxX0JsiGqFmgTgDrNVuDQuL1AnwToYH23sqxxCURxc3AiIzkc2Y-1ZSXLpS2OklBXtojTSGTsLp1Uq6KzyDltfns2DlgjWoGsxMc0 May 13 17:38:29.151772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:38:29.151772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:38:29.151772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:38:29.151772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:38:29.151772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:38:29.151772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:38:29.151772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: ae7b37b41d944427945d783a460ca12a May 13 17:38:29.151772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:29.151772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:38:29.151772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:38:29.153473 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ae7b37b41d944427945d783a460ca12a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}] May 13 17:38:29.153473 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:29.153473 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: ae7b37b41d944427945d783a460ca12a May 13 17:38:29.153473 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:29.153473 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:38:29.153473 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:38:29.153473 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:38:29.153473 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: dfc52b61bcf845d1953a5a111abb3666 May 13 17:38:29.153473 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:38:29.153473 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: > May 13 17:38:29.153473 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Instance 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 could not be found. May 13 17:38:29.153473 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'id': '149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2'} May 13 17:38:29.154661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:38:29.154661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:29.154661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:38:29.154661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:38:29.154661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:38:29.154661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:38:29.154661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:38:29.154661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:38:29.154661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:38:29.154661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:38:29.154661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 could not be found. May 13 17:38:29.154661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:38:29.154661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:29.154661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:38:29.154661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:29.154661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:29.154661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:29.154661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:38:29.154661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:38:29.154661 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:38:29.158815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:38:29.158815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:38:29.158815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:38:29.158815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:38:29.158815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:38:29.158815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:38:29.158815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:38:29.158815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 could not be found. May 13 17:38:29.158815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:38:29.158815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:29.158815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:38:29.158815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:29.158815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:29.158815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:29.158815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:38:29.158815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:38:29.158815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 could not be found. May 13 17:38:29.158815 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:38:29.160312 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-37fa0acf-0032-4202-9cbb-7d508432350c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Returning 404 to user: Instance 149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 could not be found. {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:38:29.160312 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-37fa0acf-0032-4202-9cbb-7d508432350c tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2" status: 404 len: 111 microversion: 2.1 time: 0.037573 May 13 17:38:29.160312 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 699/1415] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:29 2022] GET /compute/v2.1/servers/149bdfc0-34d8-4736-9bd5-5ddc0e45fdb2 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:38:30.393936 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7ef88df0-7f43-4aec-bf79-62fe2004cca5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:30.394503 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7ef88df0-7f43-4aec-bf79-62fe2004cca5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:30.401419 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7ef88df0-7f43-4aec-bf79-62fe2004cca5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:30.401884 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7ef88df0-7f43-4aec-bf79-62fe2004cca5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:30.404144 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7ef88df0-7f43-4aec-bf79-62fe2004cca5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:30.404144 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7ef88df0-7f43-4aec-bf79-62fe2004cca5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:30.417254 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-7ef88df0-7f43-4aec-bf79-62fe2004cca5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] HTTP exception thrown: Instance 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 could not be found. May 13 17:38:30.419425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7ef88df0-7f43-4aec-bf79-62fe2004cca5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Request method failure captured: May 13 17:38:30.419425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: DELETE /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 HTTP/1.1 May 13 17:38:30.419425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:38:30.419425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:38:30.419425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:38:30.419425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:38:30.419425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:38:30.419425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:38:30.419425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:38:30.419425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:38:30.419425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpTc_RrVmxy2iGzrfQJ2JGoLflGoXwQ8zHwIs9aTMpqZXeC78NlpwKZWhCbBdWoUAU_vvb08rrsxX0JsiGqFmgTgDrNVuDQuL1AnwToYH23sqxxCURxc3AiIzkc2Y-1ZSXLpS2OklBXtojTSGTsLp1Uq6KzyDltfns2DlgjWoGsxMc0 May 13 17:38:30.419425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:38:30.419425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:38:30.419425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:38:30.419425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:38:30.419425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:38:30.419425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:38:30.419425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: ae7b37b41d944427945d783a460ca12a May 13 17:38:30.419425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:30.419425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:38:30.419425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:38:30.420988 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ae7b37b41d944427945d783a460ca12a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}] May 13 17:38:30.420988 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:30.420988 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: ae7b37b41d944427945d783a460ca12a May 13 17:38:30.420988 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:30.420988 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:38:30.420988 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:38:30.420988 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:38:30.420988 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: dfc52b61bcf845d1953a5a111abb3666 May 13 17:38:30.420988 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:38:30.420988 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: > May 13 17:38:30.420988 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Instance 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 could not be found. May 13 17:38:30.420988 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '271501e4-dcad-4de1-92a7-8ad28c0dc5e0'} May 13 17:38:30.421895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:38:30.421895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:30.421895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:38:30.421895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:38:30.421895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:38:30.421895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:38:30.421895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:38:30.421895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:38:30.421895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:38:30.421895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:38:30.421895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 could not be found. May 13 17:38:30.421895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:30.421895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:30.421895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:30.421895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:30.421895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:30.421895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:30.421895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:38:30.421895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:38:30.421895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:38:30.423256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:38:30.423256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 17:38:30.423256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 17:38:30.423256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 17:38:30.423256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 17:38:30.423256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:38:30.423256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:38:30.423256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:38:30.423256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:38:30.423256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 could not be found. May 13 17:38:30.423256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:30.423256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:30.423256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:30.423256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:30.423256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:30.423256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:30.423256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:38:30.423256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:38:30.423256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 could not be found. May 13 17:38:30.423256 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:30.424513 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7ef88df0-7f43-4aec-bf79-62fe2004cca5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Returning 404 to user: Instance 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:38:30.424513 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7ef88df0-7f43-4aec-bf79-62fe2004cca5 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "DELETE /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 404 len: 111 microversion: 2.1 time: 0.030835 May 13 17:38:30.424513 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 717/1416] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:38:30 2022] DELETE /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:38:30.431573 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b2f5ab06-6d5b-4cd7-942c-6b11d76defb1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:30.436156 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-b2f5ab06-6d5b-4cd7-942c-6b11d76defb1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] [instance: 271501e4-dcad-4de1-92a7-8ad28c0dc5e0] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:30.439633 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b2f5ab06-6d5b-4cd7-942c-6b11d76defb1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:30.440091 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b2f5ab06-6d5b-4cd7-942c-6b11d76defb1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:30.440873 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b2f5ab06-6d5b-4cd7-942c-6b11d76defb1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:30.441309 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-b2f5ab06-6d5b-4cd7-942c-6b11d76defb1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:30.455423 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-b2f5ab06-6d5b-4cd7-942c-6b11d76defb1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] HTTP exception thrown: Instance 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 could not be found. May 13 17:38:30.456947 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b2f5ab06-6d5b-4cd7-942c-6b11d76defb1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Request method failure captured: May 13 17:38:30.456947 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 HTTP/1.1 May 13 17:38:30.456947 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:38:30.456947 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:38:30.456947 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:38:30.456947 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 0 May 13 17:38:30.456947 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:38:30.456947 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:38:30.456947 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:38:30.456947 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:38:30.456947 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpTc_RrVmxy2iGzrfQJ2JGoLflGoXwQ8zHwIs9aTMpqZXeC78NlpwKZWhCbBdWoUAU_vvb08rrsxX0JsiGqFmgTgDrNVuDQuL1AnwToYH23sqxxCURxc3AiIzkc2Y-1ZSXLpS2OklBXtojTSGTsLp1Uq6KzyDltfns2DlgjWoGsxMc0 May 13 17:38:30.456947 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:38:30.456947 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:38:30.456947 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:38:30.456947 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:38:30.456947 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:38:30.456947 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:38:30.456947 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: ae7b37b41d944427945d783a460ca12a May 13 17:38:30.456947 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:30.456947 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:38:30.456947 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:38:30.458614 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ae7b37b41d944427945d783a460ca12a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ae7b37b41d944427945d783a460ca12a"}]}] May 13 17:38:30.458614 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:30.458614 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: ae7b37b41d944427945d783a460ca12a May 13 17:38:30.458614 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-908235212 May 13 17:38:30.458614 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:38:30.458614 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:38:30.458614 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:38:30.458614 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: dfc52b61bcf845d1953a5a111abb3666 May 13 17:38:30.458614 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-AttachVolumeNegativeTest-908235212-project May 13 17:38:30.458614 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: > May 13 17:38:30.458614 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Instance 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 could not be found. May 13 17:38:30.458614 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'id': '271501e4-dcad-4de1-92a7-8ad28c0dc5e0'} May 13 17:38:30.462341 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:38:30.462341 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:30.462341 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:38:30.462341 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:38:30.462341 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:38:30.462341 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:38:30.462341 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:38:30.462341 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:38:30.462341 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:38:30.462341 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:38:30.462341 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 could not be found. May 13 17:38:30.462341 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:38:30.462341 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:30.462341 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:38:30.462341 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:30.462341 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:30.462341 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:30.462341 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:38:30.462341 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:38:30.462341 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:38:30.463908 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:38:30.463908 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:38:30.463908 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:38:30.463908 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:38:30.463908 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:38:30.463908 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:38:30.463908 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:38:30.463908 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 could not be found. May 13 17:38:30.463908 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:38:30.463908 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:30.463908 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:38:30.463908 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:30.463908 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:30.463908 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:30.463908 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:38:30.463908 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:38:30.463908 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 could not be found. May 13 17:38:30.463908 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:38:30.465255 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-b2f5ab06-6d5b-4cd7-942c-6b11d76defb1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] Returning 404 to user: Instance 271501e4-dcad-4de1-92a7-8ad28c0dc5e0 could not be found. {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:38:30.465255 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-b2f5ab06-6d5b-4cd7-942c-6b11d76defb1 tempest-AttachVolumeNegativeTest-908235212 tempest-AttachVolumeNegativeTest-908235212-project] 10.222.0.64 "GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0" status: 404 len: 111 microversion: 2.1 time: 0.032271 May 13 17:38:30.465255 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 700/1417] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:30 2022] GET /compute/v2.1/servers/271501e4-dcad-4de1-92a7-8ad28c0dc5e0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:38:34.422670 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-5881f59a-a0f6-405a-aaff-5090be1827dc tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:34.423207 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5881f59a-a0f6-405a-aaff-5090be1827dc tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:34.430118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5881f59a-a0f6-405a-aaff-5090be1827dc tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:34.430660 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5881f59a-a0f6-405a-aaff-5090be1827dc tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:34.431551 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5881f59a-a0f6-405a-aaff-5090be1827dc tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:34.432206 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-5881f59a-a0f6-405a-aaff-5090be1827dc tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:34.461681 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-5881f59a-a0f6-405a-aaff-5090be1827dc tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Going to try to terminate instance {{(pid=117493) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 17:38:34.563432 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d35d6efd-1930-4f5d-b0cd-15d43a5a0c9d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:34.564358 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d35d6efd-1930-4f5d-b0cd-15d43a5a0c9d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:34.571861 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d35d6efd-1930-4f5d-b0cd-15d43a5a0c9d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:34.572363 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d35d6efd-1930-4f5d-b0cd-15d43a5a0c9d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:34.573177 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d35d6efd-1930-4f5d-b0cd-15d43a5a0c9d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:34.573640 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d35d6efd-1930-4f5d-b0cd-15d43a5a0c9d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:34.609401 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d35d6efd-1930-4f5d-b0cd-15d43a5a0c9d tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049927 May 13 17:38:34.610914 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 701/1418] 10.222.0.64 () {60 vars in 1342 bytes} [Fri May 13 17:38:34 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:38:34.669924 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-0cef22dd-5f15-437e-8973-3f112a20de4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:34.670743 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-0cef22dd-5f15-437e-8973-3f112a20de4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:34.678317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0cef22dd-5f15-437e-8973-3f112a20de4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:34.678832 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0cef22dd-5f15-437e-8973-3f112a20de4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:34.679709 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0cef22dd-5f15-437e-8973-3f112a20de4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:34.680234 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0cef22dd-5f15-437e-8973-3f112a20de4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:34.714332 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-0cef22dd-5f15-437e-8973-3f112a20de4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Going to try to terminate instance {{(pid=117492) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 17:38:34.792535 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-5881f59a-a0f6-405a-aaff-5090be1827dc tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "DELETE /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 204 len: 0 microversion: 2.1 time: 0.373646 May 13 17:38:34.793147 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 718/1419] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:38:34 2022] DELETE /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 0 bytes in 375 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 17:38:34.801418 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-c0a2e79b-2459-4263-baa3-4cddd18bfb0d tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:34.802668 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-c0a2e79b-2459-4263-baa3-4cddd18bfb0d tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:34.808697 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c0a2e79b-2459-4263-baa3-4cddd18bfb0d tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:34.809151 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c0a2e79b-2459-4263-baa3-4cddd18bfb0d tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:34.809930 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c0a2e79b-2459-4263-baa3-4cddd18bfb0d tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:34.810372 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-c0a2e79b-2459-4263-baa3-4cddd18bfb0d tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:34.944901 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-c0a2e79b-2459-4263-baa3-4cddd18bfb0d tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:34.952359 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-c0a2e79b-2459-4263-baa3-4cddd18bfb0d tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 200 len: 1579 microversion: 2.1 time: 0.154878 May 13 17:38:34.952928 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 719/1420] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:34 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 1579 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:38:35.045224 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-0cef22dd-5f15-437e-8973-3f112a20de4b tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "DELETE /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 204 len: 0 microversion: 2.20 time: 0.378995 May 13 17:38:35.046053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 702/1421] 10.222.0.64 () {60 vars in 1279 bytes} [Fri May 13 17:38:34 2022] DELETE /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 17:38:35.054811 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-34828a7c-886d-4be4-b518-15dd199d541a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:35.055475 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-34828a7c-886d-4be4-b518-15dd199d541a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:35.061322 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-34828a7c-886d-4be4-b518-15dd199d541a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:35.061813 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-34828a7c-886d-4be4-b518-15dd199d541a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:35.062620 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-34828a7c-886d-4be4-b518-15dd199d541a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:35.063065 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-34828a7c-886d-4be4-b518-15dd199d541a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:35.194234 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-34828a7c-886d-4be4-b518-15dd199d541a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:35.202095 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-34828a7c-886d-4be4-b518-15dd199d541a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:35.203610 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-34828a7c-886d-4be4-b518-15dd199d541a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:35.206738 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-34828a7c-886d-4be4-b518-15dd199d541a tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1724 microversion: 2.20 time: 0.154550 May 13 17:38:35.206738 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 720/1422] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:38:35 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:38:35.970671 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-675e7c4a-84a0-40ee-91a5-6c0530ebcd85 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:35.971435 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-675e7c4a-84a0-40ee-91a5-6c0530ebcd85 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:35.977853 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-675e7c4a-84a0-40ee-91a5-6c0530ebcd85 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:35.978427 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-675e7c4a-84a0-40ee-91a5-6c0530ebcd85 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:35.979074 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-675e7c4a-84a0-40ee-91a5-6c0530ebcd85 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:35.979958 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-675e7c4a-84a0-40ee-91a5-6c0530ebcd85 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:36.115547 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-675e7c4a-84a0-40ee-91a5-6c0530ebcd85 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:36.123063 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-675e7c4a-84a0-40ee-91a5-6c0530ebcd85 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 200 len: 1579 microversion: 2.1 time: 0.156791 May 13 17:38:36.123823 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 703/1423] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:35 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 1579 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:38:36.224595 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6bdd77e9-230a-44b6-a02e-b78c1accf6ed tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:36.225218 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6bdd77e9-230a-44b6-a02e-b78c1accf6ed tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:36.231926 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6bdd77e9-230a-44b6-a02e-b78c1accf6ed tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:36.232424 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6bdd77e9-230a-44b6-a02e-b78c1accf6ed tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:36.233187 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6bdd77e9-230a-44b6-a02e-b78c1accf6ed tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:36.233736 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6bdd77e9-230a-44b6-a02e-b78c1accf6ed tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:36.361604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6bdd77e9-230a-44b6-a02e-b78c1accf6ed tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:36.369308 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6bdd77e9-230a-44b6-a02e-b78c1accf6ed tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:36.370798 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6bdd77e9-230a-44b6-a02e-b78c1accf6ed tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:36.371991 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6bdd77e9-230a-44b6-a02e-b78c1accf6ed tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1724 microversion: 2.20 time: 0.151978 May 13 17:38:36.372568 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 721/1424] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:38:36 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:38:37.141281 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a96c3b9d-70b8-417a-8801-4f5f72939981 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:37.141886 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a96c3b9d-70b8-417a-8801-4f5f72939981 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:37.148195 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a96c3b9d-70b8-417a-8801-4f5f72939981 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:37.148644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a96c3b9d-70b8-417a-8801-4f5f72939981 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:37.153080 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a96c3b9d-70b8-417a-8801-4f5f72939981 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:37.153080 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a96c3b9d-70b8-417a-8801-4f5f72939981 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:37.295468 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a96c3b9d-70b8-417a-8801-4f5f72939981 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:37.303772 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a96c3b9d-70b8-417a-8801-4f5f72939981 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 200 len: 1579 microversion: 2.1 time: 0.166427 May 13 17:38:37.304641 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 704/1425] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:37 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 1579 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:38:37.391417 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8796a4dc-fe1e-419f-8255-70c93533e782 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:37.391983 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8796a4dc-fe1e-419f-8255-70c93533e782 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:37.398196 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8796a4dc-fe1e-419f-8255-70c93533e782 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:37.398641 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8796a4dc-fe1e-419f-8255-70c93533e782 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:37.399423 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8796a4dc-fe1e-419f-8255-70c93533e782 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:37.399854 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8796a4dc-fe1e-419f-8255-70c93533e782 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:37.533591 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8796a4dc-fe1e-419f-8255-70c93533e782 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:37.542500 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8796a4dc-fe1e-419f-8255-70c93533e782 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:37.544417 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8796a4dc-fe1e-419f-8255-70c93533e782 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:37.545295 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8796a4dc-fe1e-419f-8255-70c93533e782 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1724 microversion: 2.20 time: 0.157930 May 13 17:38:37.545861 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 722/1426] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:38:37 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:38:38.321753 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-eeb7a929-9f67-4979-bceb-c45fc6335313 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:38.322353 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-eeb7a929-9f67-4979-bceb-c45fc6335313 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:38.329588 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-eeb7a929-9f67-4979-bceb-c45fc6335313 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:38.330253 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-eeb7a929-9f67-4979-bceb-c45fc6335313 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:38.331367 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-eeb7a929-9f67-4979-bceb-c45fc6335313 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:38.331971 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-eeb7a929-9f67-4979-bceb-c45fc6335313 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:38.563155 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-ec13ddd2-8204-495f-a656-3b221aa50c63 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:38.569603 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-ec13ddd2-8204-495f-a656-3b221aa50c63 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:38.571212 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ec13ddd2-8204-495f-a656-3b221aa50c63 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:38.571670 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ec13ddd2-8204-495f-a656-3b221aa50c63 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:38.572449 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ec13ddd2-8204-495f-a656-3b221aa50c63 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:38.573013 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-ec13ddd2-8204-495f-a656-3b221aa50c63 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:38.639261 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-eeb7a929-9f67-4979-bceb-c45fc6335313 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:38.646646 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-eeb7a929-9f67-4979-bceb-c45fc6335313 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 200 len: 1579 microversion: 2.1 time: 0.329163 May 13 17:38:38.647253 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 705/1427] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:38 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 1579 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:38:38.679017 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ec13ddd2-8204-495f-a656-3b221aa50c63 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:38.687963 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ec13ddd2-8204-495f-a656-3b221aa50c63 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:38.689118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-ec13ddd2-8204-495f-a656-3b221aa50c63 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:38.690836 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-ec13ddd2-8204-495f-a656-3b221aa50c63 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1656 microversion: 2.20 time: 0.131573 May 13 17:38:38.691709 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 723/1428] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:38:38 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1656 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 13 17:38:38.990558 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-79f95a8f-6d8e-4d44-aa69-99a6326550aa req-8164f7a0-91e1-4200-876d-6c0c6899a824 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14e3c7f8-88a0-4922-9bbe-0ebf07125a8a", "name": "network-vif-deleted", "tag": "acf21395-ff17-45fa-b717-d3bb2054575b"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:38:39.006372 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-79f95a8f-6d8e-4d44-aa69-99a6326550aa req-8164f7a0-91e1-4200-876d-6c0c6899a824 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:39.006819 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-79f95a8f-6d8e-4d44-aa69-99a6326550aa req-8164f7a0-91e1-4200-876d-6c0c6899a824 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:39.028412 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-79f95a8f-6d8e-4d44-aa69-99a6326550aa req-8164f7a0-91e1-4200-876d-6c0c6899a824 service nova] Creating event network-vif-deleted:acf21395-ff17-45fa-b717-d3bb2054575b for instance 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a on hv-cinder-84178 May 13 17:38:39.034800 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-79f95a8f-6d8e-4d44-aa69-99a6326550aa req-8164f7a0-91e1-4200-876d-6c0c6899a824 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048478 May 13 17:38:39.035659 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 706/1429] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:38:39.168908 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-75f2b4e2-45f9-4ccd-9ba4-1211ea6fb3e4 req-7c09698d-cfcb-4b85-b090-3a970779f921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "28943379-c589-47c4-939d-c9c2b0e67b7f", "name": "network-vif-deleted", "tag": "ec51b328-6c86-4e0d-9a2e-180d591317ab"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:38:39.204767 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-75f2b4e2-45f9-4ccd-9ba4-1211ea6fb3e4 req-7c09698d-cfcb-4b85-b090-3a970779f921 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:39.205600 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-75f2b4e2-45f9-4ccd-9ba4-1211ea6fb3e4 req-7c09698d-cfcb-4b85-b090-3a970779f921 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:39.233794 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-75f2b4e2-45f9-4ccd-9ba4-1211ea6fb3e4 req-7c09698d-cfcb-4b85-b090-3a970779f921 service nova] Creating event network-vif-deleted:ec51b328-6c86-4e0d-9a2e-180d591317ab for instance 28943379-c589-47c4-939d-c9c2b0e67b7f on hv-cinder-84178 May 13 17:38:39.249203 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-75f2b4e2-45f9-4ccd-9ba4-1211ea6fb3e4 req-7c09698d-cfcb-4b85-b090-3a970779f921 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084727 May 13 17:38:39.254849 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 724/1430] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:38:39.664301 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-cb375321-eac3-441b-be55-3a5a3a660ad8 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:39.665050 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-cb375321-eac3-441b-be55-3a5a3a660ad8 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:39.673201 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cb375321-eac3-441b-be55-3a5a3a660ad8 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:39.674382 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cb375321-eac3-441b-be55-3a5a3a660ad8 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:39.675448 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cb375321-eac3-441b-be55-3a5a3a660ad8 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:39.676068 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cb375321-eac3-441b-be55-3a5a3a660ad8 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:39.715512 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8137333a-2637-4dce-802b-5d41050be141 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:39.715978 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8137333a-2637-4dce-802b-5d41050be141 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:39.729749 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8137333a-2637-4dce-802b-5d41050be141 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:39.731678 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8137333a-2637-4dce-802b-5d41050be141 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:39.735386 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8137333a-2637-4dce-802b-5d41050be141 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:39.736018 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8137333a-2637-4dce-802b-5d41050be141 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:39.779423 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8137333a-2637-4dce-802b-5d41050be141 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:39.780726 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8137333a-2637-4dce-802b-5d41050be141 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:39.781578 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.objects.instance [None req-8137333a-2637-4dce-802b-5d41050be141 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lazy-loading 'fault' on Instance uuid 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a {{(pid=117493) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:38:39.809784 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-cb375321-eac3-441b-be55-3a5a3a660ad8 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:39.821859 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-cb375321-eac3-441b-be55-3a5a3a660ad8 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 200 len: 1226 microversion: 2.1 time: 0.160998 May 13 17:38:39.826746 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 707/1431] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:39 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 1226 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:38:39.899041 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8137333a-2637-4dce-802b-5d41050be141 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:39.913207 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8137333a-2637-4dce-802b-5d41050be141 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:39.916106 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8137333a-2637-4dce-802b-5d41050be141 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '57f36ff6dbd24787baf10788bdf8a1f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c34f44042ac43cc8a6a7937c0683120', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:39.918107 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8137333a-2637-4dce-802b-5d41050be141 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 200 len: 1372 microversion: 2.20 time: 0.207523 May 13 17:38:39.919183 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 725/1432] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:38:39 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 1372 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 13 17:38:40.843185 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-cb37e9c1-5328-4459-ab02-8b5b4954feea tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:40.887662 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-cb37e9c1-5328-4459-ab02-8b5b4954feea tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:40.887662 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cb37e9c1-5328-4459-ab02-8b5b4954feea tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:40.887662 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cb37e9c1-5328-4459-ab02-8b5b4954feea tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:40.887662 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cb37e9c1-5328-4459-ab02-8b5b4954feea tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:40.888104 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cb37e9c1-5328-4459-ab02-8b5b4954feea tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:40.888104 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cb37e9c1-5328-4459-ab02-8b5b4954feea tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:40.888104 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-cb37e9c1-5328-4459-ab02-8b5b4954feea tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:40.888104 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.objects.instance [None req-cb37e9c1-5328-4459-ab02-8b5b4954feea tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lazy-loading 'fault' on Instance uuid 28943379-c589-47c4-939d-c9c2b0e67b7f {{(pid=117492) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 13 17:38:40.927759 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-cb37e9c1-5328-4459-ab02-8b5b4954feea tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:40.935455 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-cb37e9c1-5328-4459-ab02-8b5b4954feea tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 200 len: 1231 microversion: 2.1 time: 0.096170 May 13 17:38:40.939385 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 708/1433] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:40 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 1231 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:38:40.939515 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9d8c15e7-24e5-4776-98c7-735f21ce86fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:40.939515 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9d8c15e7-24e5-4776-98c7-735f21ce86fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:40.947210 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9d8c15e7-24e5-4776-98c7-735f21ce86fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:40.947664 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9d8c15e7-24e5-4776-98c7-735f21ce86fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:40.948434 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9d8c15e7-24e5-4776-98c7-735f21ce86fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:40.948873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9d8c15e7-24e5-4776-98c7-735f21ce86fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:40.962265 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-9d8c15e7-24e5-4776-98c7-735f21ce86fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] HTTP exception thrown: Instance 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a could not be found. May 13 17:38:40.964088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9d8c15e7-24e5-4776-98c7-735f21ce86fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Request method failure captured: May 13 17:38:40.964088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a HTTP/1.1 May 13 17:38:40.964088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:38:40.964088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:38:40.964088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:38:40.964088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:38:40.964088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:38:40.964088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:38:40.964088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:38:40.964088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:38:40.964088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpTaRJfB6H8zu6B2CgzgxRB80vA32AaEwFYPYtSaLQa4x9RPPSQqTrlWhMjDoBsvqya2p_q_cyhwT_ilvGKa26b4nWmcU7dgakbW2Rj5sa6EJbnojbsZfsjJCYP50-IeuO6eg4XrZvawrh9WyGeK9SwqFw3DmwpNEjyghK4kCcRW7rU May 13 17:38:40.964088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:38:40.964088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:38:40.964088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:38:40.964088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:38:40.964088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Openstack-Nova-Api-Version: 2.20 May 13 17:38:40.964088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:38:40.964088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:38:40.964088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 6c34f44042ac43cc8a6a7937c0683120 May 13 17:38:40.964088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-586539843 May 13 17:38:40.964088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:38:40.964088 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:38:40.966015 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6c34f44042ac43cc8a6a7937c0683120"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6c34f44042ac43cc8a6a7937c0683120"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6c34f44042ac43cc8a6a7937c0683120"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6c34f44042ac43cc8a6a7937c0683120"}]}] May 13 17:38:40.966015 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-AttachVolumeShelveTestJSON-586539843 May 13 17:38:40.966015 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 6c34f44042ac43cc8a6a7937c0683120 May 13 17:38:40.966015 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-586539843 May 13 17:38:40.966015 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-AttachVolumeShelveTestJSON-586539843-project May 13 17:38:40.966015 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:38:40.966015 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:38:40.966015 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: 57f36ff6dbd24787baf10788bdf8a1f4 May 13 17:38:40.966015 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-AttachVolumeShelveTestJSON-586539843-project May 13 17:38:40.966015 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: > May 13 17:38:40.966015 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Instance 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a could not be found. May 13 17:38:40.966015 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '14e3c7f8-88a0-4922-9bbe-0ebf07125a8a'} May 13 17:38:40.967009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:38:40.967009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:40.967009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:38:40.967009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:38:40.967009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:38:40.967009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:38:40.967009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:38:40.967009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:38:40.967009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:38:40.967009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:38:40.967009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a could not be found. May 13 17:38:40.967009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:40.967009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:40.967009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:40.967009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:40.967009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:40.967009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:40.967009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:38:40.967009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:38:40.967009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:38:40.973714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:38:40.973714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:38:40.973714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:38:40.973714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:38:40.973714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:38:40.973714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:38:40.973714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:38:40.973714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a could not be found. May 13 17:38:40.973714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:40.973714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:40.973714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:40.973714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:40.973714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:40.973714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:40.973714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:38:40.973714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:38:40.973714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a could not be found. May 13 17:38:40.973714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:40.975601 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9d8c15e7-24e5-4776-98c7-735f21ce86fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Returning 404 to user: Instance 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:38:40.975601 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9d8c15e7-24e5-4776-98c7-735f21ce86fd tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 404 len: 111 microversion: 2.20 time: 0.032215 May 13 17:38:40.975601 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 726/1434] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:38:40 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 13 17:38:40.982433 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-46ef8fb4-e58c-41ff-838a-d09c8c7cfdcc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '.version_select at 0x7fa084ca7a60>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:41.086177 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-46ef8fb4-e58c-41ff-838a-d09c8c7cfdcc tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898797271" status: 204 len: 0 microversion: 2.20 time: 0.109694 May 13 17:38:41.086722 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 709/1435] 10.222.0.64 () {60 vars in 1261 bytes} [Fri May 13 17:38:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1898797271 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 13 17:38:41.952602 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7e07547c-4f5e-4085-b7fd-d99a0401c707 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:41.953214 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7e07547c-4f5e-4085-b7fd-d99a0401c707 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:41.960560 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7e07547c-4f5e-4085-b7fd-d99a0401c707 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:41.961014 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7e07547c-4f5e-4085-b7fd-d99a0401c707 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:41.961791 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7e07547c-4f5e-4085-b7fd-d99a0401c707 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:41.962349 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7e07547c-4f5e-4085-b7fd-d99a0401c707 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:41.975597 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-7e07547c-4f5e-4085-b7fd-d99a0401c707 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] HTTP exception thrown: Instance 28943379-c589-47c4-939d-c9c2b0e67b7f could not be found. May 13 17:38:41.977118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7e07547c-4f5e-4085-b7fd-d99a0401c707 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Request method failure captured: May 13 17:38:41.977118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f HTTP/1.1 May 13 17:38:41.977118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:38:41.977118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:38:41.977118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:38:41.977118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:38:41.977118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:38:41.977118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:38:41.977118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:38:41.977118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:38:41.977118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpbIJS0Ge9t1DxCI2iC1Lb6YBjFX9xSuD6l_gEFNAJlxamiQplE07vcLq53y1WIzjIUkO30iIjWLvqh3-lAsVBmwcU_8Ys3w3tLJFKjdxPYj2yKw6_3vD25IxrS2Eid4K6B4Hf0C7Sp2TkdCIY6HRBNcQwG8NDBsE4sNW4AHLY2xLGw May 13 17:38:41.977118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:38:41.977118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:38:41.977118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:38:41.977118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:38:41.977118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:38:41.977118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:38:41.977118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 60fd06693c624da5aa61222dfbde5b25 May 13 17:38:41.977118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-TestVolumeBootPattern-381584425 May 13 17:38:41.977118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:38:41.977118 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:38:41.978733 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/60fd06693c624da5aa61222dfbde5b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60fd06693c624da5aa61222dfbde5b25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_60fd06693c624da5aa61222dfbde5b25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60fd06693c624da5aa61222dfbde5b25"}]}] May 13 17:38:41.978733 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-TestVolumeBootPattern-381584425 May 13 17:38:41.978733 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 60fd06693c624da5aa61222dfbde5b25 May 13 17:38:41.978733 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-TestVolumeBootPattern-381584425 May 13 17:38:41.978733 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-TestVolumeBootPattern-381584425-project May 13 17:38:41.978733 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:38:41.978733 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:38:41.978733 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: 45482c562be6438ebd456ee9512ef3e8 May 13 17:38:41.978733 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-TestVolumeBootPattern-381584425-project May 13 17:38:41.978733 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: > May 13 17:38:41.978733 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Instance 28943379-c589-47c4-939d-c9c2b0e67b7f could not be found. May 13 17:38:41.978733 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '28943379-c589-47c4-939d-c9c2b0e67b7f'} May 13 17:38:41.980156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:38:41.980156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:41.980156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:38:41.980156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:38:41.980156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:38:41.980156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:38:41.980156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:38:41.980156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:38:41.980156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:38:41.980156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:38:41.980156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28943379-c589-47c4-939d-c9c2b0e67b7f could not be found. May 13 17:38:41.980156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:41.980156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:41.980156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:41.980156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:41.980156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:41.980156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:41.980156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:38:41.980156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:38:41.980156 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:38:41.981620 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:38:41.981620 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:38:41.981620 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:38:41.981620 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:38:41.981620 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:38:41.981620 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:38:41.981620 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:38:41.981620 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28943379-c589-47c4-939d-c9c2b0e67b7f could not be found. May 13 17:38:41.981620 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:41.981620 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:41.981620 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:41.981620 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:41.981620 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:41.981620 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:41.981620 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:38:41.981620 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:38:41.981620 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28943379-c589-47c4-939d-c9c2b0e67b7f could not be found. May 13 17:38:41.981620 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:41.982998 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7e07547c-4f5e-4085-b7fd-d99a0401c707 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Returning 404 to user: Instance 28943379-c589-47c4-939d-c9c2b0e67b7f could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:38:41.982998 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7e07547c-4f5e-4085-b7fd-d99a0401c707 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 404 len: 111 microversion: 2.1 time: 0.029808 May 13 17:38:41.982998 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 727/1436] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:41 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:38:42.075346 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3ef3e287-0b9e-4d5c-96f8-d4cf956dcc10 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1819379116", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1402304854", "security_groups": [{"name": "tempest-secgroup-smoke-2107664403"}], "block_device_mapping_v2": [{"uuid": "ac79cb24-8dbf-4769-b9c1-81bf91ab54a5", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9bc3da8d-37aa-4c42-a26a-ff8ce273072b"}]}} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:38:42.203850 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.network.neutron [None req-3ef3e287-0b9e-4d5c-96f8-d4cf956dcc10 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] validate_networks() for [('9bc3da8d-37aa-4c42-a26a-ff8ce273072b', None, None, None, None, None)] {{(pid=117492) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 17:38:42.679565 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-3ef3e287-0b9e-4d5c-96f8-d4cf956dcc10 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Flavor limits 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 17:38:42.679565 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-3ef3e287-0b9e-4d5c-96f8-d4cf956dcc10 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Image limits 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 17:38:42.680207 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-3ef3e287-0b9e-4d5c-96f8-d4cf956dcc10 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Flavor pref 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 17:38:42.680816 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-3ef3e287-0b9e-4d5c-96f8-d4cf956dcc10 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Image pref 0:0:0 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 17:38:42.681279 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.virt.hardware [None req-3ef3e287-0b9e-4d5c-96f8-d4cf956dcc10 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117492) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 17:38:42.690504 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3ef3e287-0b9e-4d5c-96f8-d4cf956dcc10 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:42.690974 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3ef3e287-0b9e-4d5c-96f8-d4cf956dcc10 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:42.691907 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3ef3e287-0b9e-4d5c-96f8-d4cf956dcc10 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:42.692253 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3ef3e287-0b9e-4d5c-96f8-d4cf956dcc10 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:42.712649 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-3ef3e287-0b9e-4d5c-96f8-d4cf956dcc10 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Getting quotas for project 60fd06693c624da5aa61222dfbde5b25. Resources: {'ram', 'instances', 'cores'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:38:42.717161 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.quota [None req-3ef3e287-0b9e-4d5c-96f8-d4cf956dcc10 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Getting quotas for user 45482c562be6438ebd456ee9512ef3e8 and project 60fd06693c624da5aa61222dfbde5b25. Resources: {'ram', 'instances', 'cores'} {{(pid=117492) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:38:42.779243 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3ef3e287-0b9e-4d5c-96f8-d4cf956dcc10 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Going to run 1 instances... {{(pid=117492) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 17:38:42.781478 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3ef3e287-0b9e-4d5c-96f8-d4cf956dcc10 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ac79cb24-8dbf-4769-b9c1-81bf91ab54a5',volume_size=None,volume_type=None)] {{(pid=117492) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 17:38:43.283861 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4e56c6ad-2cec-4dbb-96e4-09ecb3acb828 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:43.284959 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4e56c6ad-2cec-4dbb-96e4-09ecb3acb828 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:43.297348 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4e56c6ad-2cec-4dbb-96e4-09ecb3acb828 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:43.298014 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4e56c6ad-2cec-4dbb-96e4-09ecb3acb828 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:43.299116 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4e56c6ad-2cec-4dbb-96e4-09ecb3acb828 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:43.299802 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4e56c6ad-2cec-4dbb-96e4-09ecb3acb828 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:43.318792 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-4e56c6ad-2cec-4dbb-96e4-09ecb3acb828 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] HTTP exception thrown: Instance 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a could not be found. May 13 17:38:43.323499 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4e56c6ad-2cec-4dbb-96e4-09ecb3acb828 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Request method failure captured: May 13 17:38:43.323499 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: DELETE /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a HTTP/1.1 May 13 17:38:43.323499 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:38:43.323499 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:38:43.323499 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:38:43.323499 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:38:43.323499 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:38:43.323499 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:38:43.323499 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:38:43.323499 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:38:43.323499 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpTaRJfB6H8zu6B2CgzgxRB80vA32AaEwFYPYtSaLQa4x9RPPSQqTrlWhMjDoBsvqya2p_q_cyhwT_ilvGKa26b4nWmcU7dgakbW2Rj5sa6EJbnojbsZfsjJCYP50-IeuO6eg4XrZvawrh9WyGeK9SwqFw3DmwpNEjyghK4kCcRW7rU May 13 17:38:43.323499 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:38:43.323499 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:38:43.323499 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:38:43.323499 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:38:43.323499 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Openstack-Nova-Api-Version: 2.20 May 13 17:38:43.323499 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:38:43.323499 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:38:43.323499 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 6c34f44042ac43cc8a6a7937c0683120 May 13 17:38:43.323499 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-586539843 May 13 17:38:43.323499 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:38:43.323499 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:38:43.325369 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6c34f44042ac43cc8a6a7937c0683120"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6c34f44042ac43cc8a6a7937c0683120"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6c34f44042ac43cc8a6a7937c0683120"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6c34f44042ac43cc8a6a7937c0683120"}]}] May 13 17:38:43.325369 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-AttachVolumeShelveTestJSON-586539843 May 13 17:38:43.325369 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 6c34f44042ac43cc8a6a7937c0683120 May 13 17:38:43.325369 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-586539843 May 13 17:38:43.325369 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-AttachVolumeShelveTestJSON-586539843-project May 13 17:38:43.325369 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:38:43.325369 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:38:43.325369 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: 57f36ff6dbd24787baf10788bdf8a1f4 May 13 17:38:43.325369 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-AttachVolumeShelveTestJSON-586539843-project May 13 17:38:43.325369 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: > May 13 17:38:43.325369 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Instance 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a could not be found. May 13 17:38:43.325369 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '14e3c7f8-88a0-4922-9bbe-0ebf07125a8a'} May 13 17:38:43.326294 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:38:43.326294 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:43.326294 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:38:43.326294 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:38:43.326294 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:38:43.326294 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:38:43.326294 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:38:43.326294 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:38:43.326294 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:38:43.326294 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:38:43.326294 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a could not be found. May 13 17:38:43.326294 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:43.326294 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:43.326294 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:43.326294 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:43.326294 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:43.326294 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:43.326294 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:38:43.326294 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:38:43.326294 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:38:43.328045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:38:43.328045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 17:38:43.328045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 17:38:43.328045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 17:38:43.328045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 17:38:43.328045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:38:43.328045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:38:43.328045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:38:43.328045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:38:43.328045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a could not be found. May 13 17:38:43.328045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:43.328045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:43.328045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:43.328045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:43.328045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:43.328045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:43.328045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:38:43.328045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:38:43.328045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a could not be found. May 13 17:38:43.328045 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:43.331646 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4e56c6ad-2cec-4dbb-96e4-09ecb3acb828 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Returning 404 to user: Instance 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:38:43.334440 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4e56c6ad-2cec-4dbb-96e4-09ecb3acb828 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "DELETE /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 404 len: 111 microversion: 2.20 time: 0.054794 May 13 17:38:43.335015 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 728/1437] 10.222.0.64 () {60 vars in 1279 bytes} [Fri May 13 17:38:43 2022] DELETE /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 13 17:38:43.348126 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-970b9c5e-27d9-4748-ae03-84a438f14710 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:43.348770 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-970b9c5e-27d9-4748-ae03-84a438f14710 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:43.355380 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-970b9c5e-27d9-4748-ae03-84a438f14710 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:43.356276 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-970b9c5e-27d9-4748-ae03-84a438f14710 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:43.357150 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-970b9c5e-27d9-4748-ae03-84a438f14710 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:43.357751 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-970b9c5e-27d9-4748-ae03-84a438f14710 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:43.382725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-970b9c5e-27d9-4748-ae03-84a438f14710 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] HTTP exception thrown: Instance 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a could not be found. May 13 17:38:43.382725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-970b9c5e-27d9-4748-ae03-84a438f14710 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Request method failure captured: May 13 17:38:43.382725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a HTTP/1.1 May 13 17:38:43.382725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:38:43.382725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:38:43.382725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:38:43.382725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:38:43.382725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:38:43.382725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:38:43.382725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:38:43.382725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:38:43.382725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpTaRJfB6H8zu6B2CgzgxRB80vA32AaEwFYPYtSaLQa4x9RPPSQqTrlWhMjDoBsvqya2p_q_cyhwT_ilvGKa26b4nWmcU7dgakbW2Rj5sa6EJbnojbsZfsjJCYP50-IeuO6eg4XrZvawrh9WyGeK9SwqFw3DmwpNEjyghK4kCcRW7rU May 13 17:38:43.382725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:38:43.382725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:38:43.382725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:38:43.382725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:38:43.382725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Openstack-Nova-Api-Version: 2.20 May 13 17:38:43.382725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:38:43.382725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:38:43.382725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 6c34f44042ac43cc8a6a7937c0683120 May 13 17:38:43.382725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-586539843 May 13 17:38:43.382725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:38:43.382725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:38:43.384767 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6c34f44042ac43cc8a6a7937c0683120"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6c34f44042ac43cc8a6a7937c0683120"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6c34f44042ac43cc8a6a7937c0683120"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6c34f44042ac43cc8a6a7937c0683120"}]}] May 13 17:38:43.384767 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-AttachVolumeShelveTestJSON-586539843 May 13 17:38:43.384767 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 6c34f44042ac43cc8a6a7937c0683120 May 13 17:38:43.384767 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-586539843 May 13 17:38:43.384767 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-AttachVolumeShelveTestJSON-586539843-project May 13 17:38:43.384767 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:38:43.384767 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:38:43.384767 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: 57f36ff6dbd24787baf10788bdf8a1f4 May 13 17:38:43.384767 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-AttachVolumeShelveTestJSON-586539843-project May 13 17:38:43.384767 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: > May 13 17:38:43.384767 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Instance 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a could not be found. May 13 17:38:43.384767 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '14e3c7f8-88a0-4922-9bbe-0ebf07125a8a'} May 13 17:38:43.385651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:38:43.385651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:43.385651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:38:43.385651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:38:43.385651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:38:43.385651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:38:43.385651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:38:43.385651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:38:43.385651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:38:43.385651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:38:43.385651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a could not be found. May 13 17:38:43.385651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:43.385651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:43.385651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:43.385651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:43.385651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:43.385651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:43.385651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:38:43.385651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:38:43.385651 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:38:43.387271 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:38:43.387271 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:38:43.387271 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:38:43.387271 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:38:43.387271 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:38:43.387271 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:38:43.387271 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:38:43.387271 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a could not be found. May 13 17:38:43.387271 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:43.387271 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:43.387271 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:43.387271 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:43.387271 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:43.387271 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:43.387271 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:38:43.387271 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:38:43.387271 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a could not be found. May 13 17:38:43.387271 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:43.388723 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-970b9c5e-27d9-4748-ae03-84a438f14710 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Returning 404 to user: Instance 14e3c7f8-88a0-4922-9bbe-0ebf07125a8a could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:38:43.388723 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-970b9c5e-27d9-4748-ae03-84a438f14710 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a" status: 404 len: 111 microversion: 2.20 time: 0.030828 May 13 17:38:43.388723 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 729/1438] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:38:43 2022] GET /compute/v2.1/servers/14e3c7f8-88a0-4922-9bbe-0ebf07125a8a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 17:38:43.407947 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3ef3e287-0b9e-4d5c-96f8-d4cf956dcc10 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.336597 May 13 17:38:43.408912 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 710/1439] 10.222.0.64 () {60 vars in 1146 bytes} [Fri May 13 17:38:42 2022] POST /compute/v2.1/servers => generated 406 bytes in 1338 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 17:38:43.419311 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-d9a3e6e1-6a96-49b6-a370-e16e5eafe7b6 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:43.420258 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-d9a3e6e1-6a96-49b6-a370-e16e5eafe7b6 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:43.475470 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-d9a3e6e1-6a96-49b6-a370-e16e5eafe7b6 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:43.482234 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-d9a3e6e1-6a96-49b6-a370-e16e5eafe7b6 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1095 microversion: 2.1 time: 0.067246 May 13 17:38:43.485968 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 730/1440] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:43 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:38:44.500486 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-5faf22fe-5d8e-4520-9bd9-bc55bda45c69 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:44.501859 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-5faf22fe-5d8e-4520-9bd9-bc55bda45c69 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:44.510400 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5faf22fe-5d8e-4520-9bd9-bc55bda45c69 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:44.511194 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5faf22fe-5d8e-4520-9bd9-bc55bda45c69 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:44.512135 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5faf22fe-5d8e-4520-9bd9-bc55bda45c69 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:44.512579 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5faf22fe-5d8e-4520-9bd9-bc55bda45c69 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:44.574239 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-5faf22fe-5d8e-4520-9bd9-bc55bda45c69 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:44.581715 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-5faf22fe-5d8e-4520-9bd9-bc55bda45c69 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1145 microversion: 2.1 time: 0.086480 May 13 17:38:44.582296 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 711/1441] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:44 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1145 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:38:45.601163 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b88bad74-f44b-4b78-a299-271fbe8b009c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:45.601163 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b88bad74-f44b-4b78-a299-271fbe8b009c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:45.608917 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b88bad74-f44b-4b78-a299-271fbe8b009c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:45.609489 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b88bad74-f44b-4b78-a299-271fbe8b009c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:45.610517 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b88bad74-f44b-4b78-a299-271fbe8b009c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:45.611062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b88bad74-f44b-4b78-a299-271fbe8b009c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:45.674234 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b88bad74-f44b-4b78-a299-271fbe8b009c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:45.682171 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b88bad74-f44b-4b78-a299-271fbe8b009c tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1201 microversion: 2.1 time: 0.086516 May 13 17:38:45.682962 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 731/1442] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:45 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1201 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:38:45.764092 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-9da698d0-fbe0-4ff3-91da-00935d1a0a59 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:45.764634 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-9da698d0-fbe0-4ff3-91da-00935d1a0a59 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:45.771074 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9da698d0-fbe0-4ff3-91da-00935d1a0a59 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:45.771557 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9da698d0-fbe0-4ff3-91da-00935d1a0a59 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:45.772884 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9da698d0-fbe0-4ff3-91da-00935d1a0a59 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:45.773325 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-9da698d0-fbe0-4ff3-91da-00935d1a0a59 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:45.789555 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-9da698d0-fbe0-4ff3-91da-00935d1a0a59 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] HTTP exception thrown: Instance 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 could not be found. May 13 17:38:45.791269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-9da698d0-fbe0-4ff3-91da-00935d1a0a59 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Request method failure captured: May 13 17:38:45.791269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: DELETE /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 HTTP/1.1 May 13 17:38:45.791269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:38:45.791269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:38:45.791269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:38:45.791269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 0 May 13 17:38:45.791269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:38:45.791269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:38:45.791269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:38:45.791269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:38:45.791269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpTaRJfB6H8zu6B2CgzgxRB80vA32AaEwFYPYtSaLQa4x9RPPSQqTrlWhMjDoBsvqya2p_q_cyhwT_ilvGKa26b4nWmcU7dgakbW2Rj5sa6EJbnojbsZfsjJCYP50-IeuO6eg4XrZvawrh9WyGeK9SwqFw3DmwpNEjyghK4kCcRW7rU May 13 17:38:45.791269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:38:45.791269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:38:45.791269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:38:45.791269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:38:45.791269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Openstack-Nova-Api-Version: 2.20 May 13 17:38:45.791269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:38:45.791269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:38:45.791269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: 6c34f44042ac43cc8a6a7937c0683120 May 13 17:38:45.791269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-586539843 May 13 17:38:45.791269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:38:45.791269 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:38:45.793137 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6c34f44042ac43cc8a6a7937c0683120"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6c34f44042ac43cc8a6a7937c0683120"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6c34f44042ac43cc8a6a7937c0683120"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6c34f44042ac43cc8a6a7937c0683120"}]}] May 13 17:38:45.793137 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-AttachVolumeShelveTestJSON-586539843 May 13 17:38:45.793137 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: 6c34f44042ac43cc8a6a7937c0683120 May 13 17:38:45.793137 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-586539843 May 13 17:38:45.793137 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-AttachVolumeShelveTestJSON-586539843-project May 13 17:38:45.793137 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:38:45.793137 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:38:45.793137 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: 57f36ff6dbd24787baf10788bdf8a1f4 May 13 17:38:45.793137 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-AttachVolumeShelveTestJSON-586539843-project May 13 17:38:45.793137 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: > May 13 17:38:45.793137 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Instance 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 could not be found. May 13 17:38:45.793137 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'id': '65fdbf1a-f080-4d79-b3f3-c465e5a81c67'} May 13 17:38:45.794262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:38:45.794262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:45.794262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:38:45.794262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:38:45.794262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:38:45.794262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:38:45.794262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:38:45.794262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:38:45.794262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:38:45.794262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:38:45.794262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 could not be found. May 13 17:38:45.794262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:38:45.794262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:45.794262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:38:45.794262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:45.794262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:45.794262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:45.794262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:38:45.794262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:38:45.794262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:38:45.795596 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:38:45.795596 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 17:38:45.795596 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 17:38:45.795596 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 17:38:45.795596 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 17:38:45.795596 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:38:45.795596 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:38:45.795596 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:38:45.795596 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:38:45.795596 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 could not be found. May 13 17:38:45.795596 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:38:45.795596 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:45.795596 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:38:45.795596 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:45.795596 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:45.795596 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:45.795596 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:38:45.795596 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:38:45.795596 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 could not be found. May 13 17:38:45.795596 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:38:45.797145 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-9da698d0-fbe0-4ff3-91da-00935d1a0a59 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Returning 404 to user: Instance 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 could not be found. {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:38:45.797145 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-9da698d0-fbe0-4ff3-91da-00935d1a0a59 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "DELETE /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 404 len: 111 microversion: 2.20 time: 0.037441 May 13 17:38:45.797145 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 712/1443] 10.222.0.64 () {60 vars in 1279 bytes} [Fri May 13 17:38:45 2022] DELETE /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 17:38:45.802160 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9a03af76-2e93-45c6-a500-437da1be21f4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:45.802868 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9a03af76-2e93-45c6-a500-437da1be21f4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] [instance: 65fdbf1a-f080-4d79-b3f3-c465e5a81c67] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:45.809415 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a03af76-2e93-45c6-a500-437da1be21f4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:45.809955 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a03af76-2e93-45c6-a500-437da1be21f4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:45.810732 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a03af76-2e93-45c6-a500-437da1be21f4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:45.811194 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9a03af76-2e93-45c6-a500-437da1be21f4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:45.825027 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-9a03af76-2e93-45c6-a500-437da1be21f4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] HTTP exception thrown: Instance 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 could not be found. May 13 17:38:45.828165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9a03af76-2e93-45c6-a500-437da1be21f4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Request method failure captured: May 13 17:38:45.828165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 HTTP/1.1 May 13 17:38:45.828165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:38:45.828165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:38:45.828165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:38:45.828165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:38:45.828165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:38:45.828165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:38:45.828165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:38:45.828165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:38:45.828165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpTaRJfB6H8zu6B2CgzgxRB80vA32AaEwFYPYtSaLQa4x9RPPSQqTrlWhMjDoBsvqya2p_q_cyhwT_ilvGKa26b4nWmcU7dgakbW2Rj5sa6EJbnojbsZfsjJCYP50-IeuO6eg4XrZvawrh9WyGeK9SwqFw3DmwpNEjyghK4kCcRW7rU May 13 17:38:45.828165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:38:45.828165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:38:45.828165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:38:45.828165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:38:45.828165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Openstack-Nova-Api-Version: 2.20 May 13 17:38:45.828165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:38:45.828165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:38:45.828165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 6c34f44042ac43cc8a6a7937c0683120 May 13 17:38:45.828165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-586539843 May 13 17:38:45.828165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:38:45.828165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:38:45.829920 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6c34f44042ac43cc8a6a7937c0683120"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6c34f44042ac43cc8a6a7937c0683120"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6c34f44042ac43cc8a6a7937c0683120"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6c34f44042ac43cc8a6a7937c0683120"}]}] May 13 17:38:45.829920 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-AttachVolumeShelveTestJSON-586539843 May 13 17:38:45.829920 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 6c34f44042ac43cc8a6a7937c0683120 May 13 17:38:45.829920 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-586539843 May 13 17:38:45.829920 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-AttachVolumeShelveTestJSON-586539843-project May 13 17:38:45.829920 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:38:45.829920 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:38:45.829920 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: 57f36ff6dbd24787baf10788bdf8a1f4 May 13 17:38:45.829920 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-AttachVolumeShelveTestJSON-586539843-project May 13 17:38:45.829920 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: > May 13 17:38:45.829920 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Instance 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 could not be found. May 13 17:38:45.829920 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '65fdbf1a-f080-4d79-b3f3-c465e5a81c67'} May 13 17:38:45.830940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:38:45.830940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:45.830940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:38:45.830940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:38:45.830940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:38:45.830940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:38:45.830940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:38:45.830940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:38:45.830940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:38:45.830940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:38:45.830940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 could not be found. May 13 17:38:45.830940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:45.830940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:45.830940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:45.830940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:45.830940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:45.830940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:45.830940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:38:45.830940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:38:45.830940 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:38:45.832725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:38:45.832725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:38:45.832725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:38:45.832725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:38:45.832725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:38:45.832725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:38:45.832725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:38:45.832725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 could not be found. May 13 17:38:45.832725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:45.832725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:38:45.832725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:45.832725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:38:45.832725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:38:45.832725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:38:45.832725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:38:45.832725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:38:45.832725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 could not be found. May 13 17:38:45.832725 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:38:45.834240 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9a03af76-2e93-45c6-a500-437da1be21f4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] Returning 404 to user: Instance 65fdbf1a-f080-4d79-b3f3-c465e5a81c67 could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:38:45.834240 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9a03af76-2e93-45c6-a500-437da1be21f4 tempest-AttachVolumeShelveTestJSON-586539843 tempest-AttachVolumeShelveTestJSON-586539843-project] 10.222.0.64 "GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67" status: 404 len: 111 microversion: 2.20 time: 0.031559 May 13 17:38:45.834240 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 732/1444] 10.222.0.64 () {60 vars in 1276 bytes} [Fri May 13 17:38:45 2022] GET /compute/v2.1/servers/65fdbf1a-f080-4d79-b3f3-c465e5a81c67 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 13 17:38:46.701515 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-a0efe12d-89ec-42ab-b389-34eade0d0d3b tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:46.702365 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-a0efe12d-89ec-42ab-b389-34eade0d0d3b tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:46.708550 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a0efe12d-89ec-42ab-b389-34eade0d0d3b tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:46.709330 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a0efe12d-89ec-42ab-b389-34eade0d0d3b tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:46.710442 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a0efe12d-89ec-42ab-b389-34eade0d0d3b tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:46.711157 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-a0efe12d-89ec-42ab-b389-34eade0d0d3b tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:47.084770 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-a0efe12d-89ec-42ab-b389-34eade0d0d3b tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:47.093177 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-a0efe12d-89ec-42ab-b389-34eade0d0d3b tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1279 microversion: 2.1 time: 0.396461 May 13 17:38:47.093920 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 713/1445] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:46 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1279 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:38:48.110945 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6e7c58ef-c695-4ca7-bd8b-47b4980730b8 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:48.111642 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6e7c58ef-c695-4ca7-bd8b-47b4980730b8 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:48.122370 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6e7c58ef-c695-4ca7-bd8b-47b4980730b8 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:48.122838 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6e7c58ef-c695-4ca7-bd8b-47b4980730b8 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:48.124222 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6e7c58ef-c695-4ca7-bd8b-47b4980730b8 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:48.124679 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6e7c58ef-c695-4ca7-bd8b-47b4980730b8 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:48.323893 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6e7c58ef-c695-4ca7-bd8b-47b4980730b8 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:48.337062 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6e7c58ef-c695-4ca7-bd8b-47b4980730b8 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1267 microversion: 2.1 time: 0.227521 May 13 17:38:48.337823 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 733/1446] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:48 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1267 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:38:48.807251 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-33d319cf-8a19-4a29-a797-0e5c6df4091c req-97cb3bc3-8eec-4e1c-aaa4-9cd251d484e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89b80358-f455-40eb-9c58-8246a0f5e874", "tag": "145b3c79-f4a4-4cce-a4f7-e4034da0c4e2"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:38:48.816895 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-33d319cf-8a19-4a29-a797-0e5c6df4091c req-97cb3bc3-8eec-4e1c-aaa4-9cd251d484e9 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:48.817344 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-33d319cf-8a19-4a29-a797-0e5c6df4091c req-97cb3bc3-8eec-4e1c-aaa4-9cd251d484e9 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:48.837916 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-33d319cf-8a19-4a29-a797-0e5c6df4091c req-97cb3bc3-8eec-4e1c-aaa4-9cd251d484e9 service nova] Creating event network-changed:145b3c79-f4a4-4cce-a4f7-e4034da0c4e2 for instance 89b80358-f455-40eb-9c58-8246a0f5e874 on hv-cinder-84178 May 13 17:38:48.856788 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-33d319cf-8a19-4a29-a797-0e5c6df4091c req-97cb3bc3-8eec-4e1c-aaa4-9cd251d484e9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052011 May 13 17:38:48.857711 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 714/1447] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:38:49.353777 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-4bf86cc5-d99b-4f66-8019-f1f5fa5f9c43 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:49.354321 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-4bf86cc5-d99b-4f66-8019-f1f5fa5f9c43 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:49.364070 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4bf86cc5-d99b-4f66-8019-f1f5fa5f9c43 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:49.365706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4bf86cc5-d99b-4f66-8019-f1f5fa5f9c43 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:49.367569 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4bf86cc5-d99b-4f66-8019-f1f5fa5f9c43 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:49.368847 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-4bf86cc5-d99b-4f66-8019-f1f5fa5f9c43 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:49.563593 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-4bf86cc5-d99b-4f66-8019-f1f5fa5f9c43 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:49.571911 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-4bf86cc5-d99b-4f66-8019-f1f5fa5f9c43 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1267 microversion: 2.1 time: 0.221997 May 13 17:38:49.573077 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 734/1448] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:49 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1267 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:38:50.591951 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-0d34c65e-5bab-406a-b647-1194b474d120 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:50.592757 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-0d34c65e-5bab-406a-b647-1194b474d120 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:50.599964 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0d34c65e-5bab-406a-b647-1194b474d120 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:50.601336 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0d34c65e-5bab-406a-b647-1194b474d120 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:50.610761 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0d34c65e-5bab-406a-b647-1194b474d120 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:50.611172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0d34c65e-5bab-406a-b647-1194b474d120 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:50.978647 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0d34c65e-5bab-406a-b647-1194b474d120 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:51.000758 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-0d34c65e-5bab-406a-b647-1194b474d120 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1267 microversion: 2.1 time: 0.414223 May 13 17:38:51.001728 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 715/1449] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:50 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1267 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:38:52.018425 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6a8460cb-f318-4c06-8d63-3f53a147d324 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:52.018964 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6a8460cb-f318-4c06-8d63-3f53a147d324 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:52.025502 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6a8460cb-f318-4c06-8d63-3f53a147d324 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:52.025949 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6a8460cb-f318-4c06-8d63-3f53a147d324 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:52.026981 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6a8460cb-f318-4c06-8d63-3f53a147d324 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:52.027533 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6a8460cb-f318-4c06-8d63-3f53a147d324 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:52.195826 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6a8460cb-f318-4c06-8d63-3f53a147d324 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:52.203201 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6a8460cb-f318-4c06-8d63-3f53a147d324 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1267 microversion: 2.1 time: 0.188677 May 13 17:38:52.203772 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 735/1450] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:52 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1267 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:38:53.220425 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-44402745-b7ed-459e-b8aa-c6233fe0d9d4 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:53.221043 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-44402745-b7ed-459e-b8aa-c6233fe0d9d4 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:53.227507 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-44402745-b7ed-459e-b8aa-c6233fe0d9d4 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:53.227962 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-44402745-b7ed-459e-b8aa-c6233fe0d9d4 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:53.228744 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-44402745-b7ed-459e-b8aa-c6233fe0d9d4 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:53.229188 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-44402745-b7ed-459e-b8aa-c6233fe0d9d4 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:53.405786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-44402745-b7ed-459e-b8aa-c6233fe0d9d4 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:53.413525 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-44402745-b7ed-459e-b8aa-c6233fe0d9d4 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1267 microversion: 2.1 time: 0.197080 May 13 17:38:53.414175 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 716/1451] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:53 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1267 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:38:54.434798 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-61cd9e84-91aa-45d0-ba91-6c4d047f3c99 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:54.435430 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-61cd9e84-91aa-45d0-ba91-6c4d047f3c99 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:54.441823 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61cd9e84-91aa-45d0-ba91-6c4d047f3c99 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:54.442241 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61cd9e84-91aa-45d0-ba91-6c4d047f3c99 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:54.443174 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61cd9e84-91aa-45d0-ba91-6c4d047f3c99 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:54.443614 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-61cd9e84-91aa-45d0-ba91-6c4d047f3c99 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:54.584876 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-61cd9e84-91aa-45d0-ba91-6c4d047f3c99 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:54.592714 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-61cd9e84-91aa-45d0-ba91-6c4d047f3c99 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1267 microversion: 2.1 time: 0.161777 May 13 17:38:54.593283 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 736/1452] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:54 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1267 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:38:55.610173 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-81dce394-b38a-4e07-89a5-4ab3fada34ce tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:55.610774 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-81dce394-b38a-4e07-89a5-4ab3fada34ce tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:55.617264 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-81dce394-b38a-4e07-89a5-4ab3fada34ce tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:55.617708 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-81dce394-b38a-4e07-89a5-4ab3fada34ce tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:55.618495 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-81dce394-b38a-4e07-89a5-4ab3fada34ce tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:55.618927 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-81dce394-b38a-4e07-89a5-4ab3fada34ce tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:55.749140 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-81dce394-b38a-4e07-89a5-4ab3fada34ce tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:55.761351 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-81dce394-b38a-4e07-89a5-4ab3fada34ce tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1267 microversion: 2.1 time: 0.154804 May 13 17:38:55.761960 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 717/1453] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:55 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:38:56.778873 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-6d4c85f1-4bfb-408b-829a-c72f8057d503 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:56.779512 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-6d4c85f1-4bfb-408b-829a-c72f8057d503 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:56.785986 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6d4c85f1-4bfb-408b-829a-c72f8057d503 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:56.786443 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6d4c85f1-4bfb-408b-829a-c72f8057d503 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:56.787254 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6d4c85f1-4bfb-408b-829a-c72f8057d503 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:56.787696 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-6d4c85f1-4bfb-408b-829a-c72f8057d503 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:56.942359 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-6d4c85f1-4bfb-408b-829a-c72f8057d503 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:56.953455 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-6d4c85f1-4bfb-408b-829a-c72f8057d503 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1267 microversion: 2.1 time: 0.178202 May 13 17:38:56.959550 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 737/1454] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:56 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1267 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:38:57.977094 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-011f6001-da32-41dd-bbe9-7f87bc5f54de tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:57.977709 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-011f6001-da32-41dd-bbe9-7f87bc5f54de tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:57.986861 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-011f6001-da32-41dd-bbe9-7f87bc5f54de tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:57.986861 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-011f6001-da32-41dd-bbe9-7f87bc5f54de tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:57.986861 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-011f6001-da32-41dd-bbe9-7f87bc5f54de tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:57.986861 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-011f6001-da32-41dd-bbe9-7f87bc5f54de tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:58.123313 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-011f6001-da32-41dd-bbe9-7f87bc5f54de tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:58.130602 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-011f6001-da32-41dd-bbe9-7f87bc5f54de tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1267 microversion: 2.1 time: 0.158054 May 13 17:38:58.131190 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 718/1455] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:57 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:38:59.148548 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-75a2811f-b9d5-4eb8-9937-610a30c44e5e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:38:59.149219 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-75a2811f-b9d5-4eb8-9937-610a30c44e5e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:38:59.155444 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-75a2811f-b9d5-4eb8-9937-610a30c44e5e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:59.159606 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-75a2811f-b9d5-4eb8-9937-610a30c44e5e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:59.159606 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-75a2811f-b9d5-4eb8-9937-610a30c44e5e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:38:59.159606 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-75a2811f-b9d5-4eb8-9937-610a30c44e5e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:38:59.291826 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-75a2811f-b9d5-4eb8-9937-610a30c44e5e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:38:59.299293 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-75a2811f-b9d5-4eb8-9937-610a30c44e5e tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1267 microversion: 2.1 time: 0.154567 May 13 17:38:59.300106 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 738/1456] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:38:59 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:39:00.316338 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-0e63fa72-5357-41c6-b033-665a266aa5aa tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:39:00.316940 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-0e63fa72-5357-41c6-b033-665a266aa5aa tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:39:00.323763 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0e63fa72-5357-41c6-b033-665a266aa5aa tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:00.324209 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0e63fa72-5357-41c6-b033-665a266aa5aa tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:00.324970 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0e63fa72-5357-41c6-b033-665a266aa5aa tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:00.325442 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0e63fa72-5357-41c6-b033-665a266aa5aa tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:00.457089 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0e63fa72-5357-41c6-b033-665a266aa5aa tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:39:00.465073 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-0e63fa72-5357-41c6-b033-665a266aa5aa tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1267 microversion: 2.1 time: 0.152703 May 13 17:39:00.465745 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 719/1457] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:39:00 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:39:01.482463 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-644d8b69-61f7-4ce5-bcc7-49c45d222cd3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:39:01.483084 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-644d8b69-61f7-4ce5-bcc7-49c45d222cd3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:39:01.489819 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-644d8b69-61f7-4ce5-bcc7-49c45d222cd3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:01.490599 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-644d8b69-61f7-4ce5-bcc7-49c45d222cd3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:01.491142 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-644d8b69-61f7-4ce5-bcc7-49c45d222cd3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:01.492111 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-644d8b69-61f7-4ce5-bcc7-49c45d222cd3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:01.628576 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-644d8b69-61f7-4ce5-bcc7-49c45d222cd3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:39:01.636804 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-644d8b69-61f7-4ce5-bcc7-49c45d222cd3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1267 microversion: 2.1 time: 0.158624 May 13 17:39:01.637380 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 739/1458] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:39:01 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:39:02.654027 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6192c978-0c5e-470a-9f53-ba94b87e91e3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:39:02.654646 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6192c978-0c5e-470a-9f53-ba94b87e91e3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:39:02.661010 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6192c978-0c5e-470a-9f53-ba94b87e91e3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:02.661468 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6192c978-0c5e-470a-9f53-ba94b87e91e3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:02.662239 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6192c978-0c5e-470a-9f53-ba94b87e91e3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:02.662677 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6192c978-0c5e-470a-9f53-ba94b87e91e3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:02.790457 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6192c978-0c5e-470a-9f53-ba94b87e91e3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:39:02.797945 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6192c978-0c5e-470a-9f53-ba94b87e91e3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1267 microversion: 2.1 time: 0.147685 May 13 17:39:02.798506 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 720/1459] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:39:02 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1267 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:39:03.814433 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b86bba11-21c0-4bf7-9215-2f792f44f146 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:39:03.815165 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b86bba11-21c0-4bf7-9215-2f792f44f146 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:39:03.822652 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b86bba11-21c0-4bf7-9215-2f792f44f146 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:03.823348 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b86bba11-21c0-4bf7-9215-2f792f44f146 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:03.824318 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b86bba11-21c0-4bf7-9215-2f792f44f146 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:03.824758 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b86bba11-21c0-4bf7-9215-2f792f44f146 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:04.002706 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b86bba11-21c0-4bf7-9215-2f792f44f146 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:39:04.011015 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b86bba11-21c0-4bf7-9215-2f792f44f146 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1267 microversion: 2.1 time: 0.200460 May 13 17:39:04.011963 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 740/1460] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:39:03 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1267 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:39:05.029390 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-fa1d317e-4447-4006-a953-ff6c4cf1d1b2 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:39:05.030635 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-fa1d317e-4447-4006-a953-ff6c4cf1d1b2 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:39:05.036847 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fa1d317e-4447-4006-a953-ff6c4cf1d1b2 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:05.037483 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fa1d317e-4447-4006-a953-ff6c4cf1d1b2 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:05.040240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fa1d317e-4447-4006-a953-ff6c4cf1d1b2 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:05.040240 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-fa1d317e-4447-4006-a953-ff6c4cf1d1b2 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:05.176199 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-fa1d317e-4447-4006-a953-ff6c4cf1d1b2 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:39:05.185930 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-fa1d317e-4447-4006-a953-ff6c4cf1d1b2 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1267 microversion: 2.1 time: 0.160410 May 13 17:39:05.186528 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 721/1461] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:39:05 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:39:05.911322 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-c83b999b-a87b-4ba3-a9f7-7137b361dd2c req-10de0f4c-a0a8-46d3-897a-6f3a81f093e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b80358-f455-40eb-9c58-8246a0f5e874", "name": "network-vif-plugged", "status": "completed", "tag": "145b3c79-f4a4-4cce-a4f7-e4034da0c4e2"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:39:05.922900 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-c83b999b-a87b-4ba3-a9f7-7137b361dd2c req-10de0f4c-a0a8-46d3-897a-6f3a81f093e6 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:05.923385 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-c83b999b-a87b-4ba3-a9f7-7137b361dd2c req-10de0f4c-a0a8-46d3-897a-6f3a81f093e6 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:05.940248 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-c83b999b-a87b-4ba3-a9f7-7137b361dd2c req-10de0f4c-a0a8-46d3-897a-6f3a81f093e6 service nova] Creating event network-vif-plugged:145b3c79-f4a4-4cce-a4f7-e4034da0c4e2 for instance 89b80358-f455-40eb-9c58-8246a0f5e874 on hv-cinder-84178 May 13 17:39:05.947069 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-c83b999b-a87b-4ba3-a9f7-7137b361dd2c req-10de0f4c-a0a8-46d3-897a-6f3a81f093e6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042586 May 13 17:39:05.948478 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 741/1462] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:39:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 13 17:39:06.202610 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-16e97573-707c-45bb-a4a6-a6b2526a2226 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:39:06.203243 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-16e97573-707c-45bb-a4a6-a6b2526a2226 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:39:06.209516 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-16e97573-707c-45bb-a4a6-a6b2526a2226 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:06.209967 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-16e97573-707c-45bb-a4a6-a6b2526a2226 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:06.211285 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-16e97573-707c-45bb-a4a6-a6b2526a2226 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:06.211722 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-16e97573-707c-45bb-a4a6-a6b2526a2226 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:06.342306 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-16e97573-707c-45bb-a4a6-a6b2526a2226 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:39:06.349796 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-16e97573-707c-45bb-a4a6-a6b2526a2226 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1267 microversion: 2.1 time: 0.151078 May 13 17:39:06.350364 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 722/1463] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:39:06 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:39:07.368413 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-aa1eaaab-ccdf-45b5-8b00-8932ab2cc384 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:39:07.369109 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-aa1eaaab-ccdf-45b5-8b00-8932ab2cc384 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:39:07.375700 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aa1eaaab-ccdf-45b5-8b00-8932ab2cc384 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:07.376154 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aa1eaaab-ccdf-45b5-8b00-8932ab2cc384 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:07.376917 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aa1eaaab-ccdf-45b5-8b00-8932ab2cc384 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:07.377365 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-aa1eaaab-ccdf-45b5-8b00-8932ab2cc384 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:07.506906 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-aa1eaaab-ccdf-45b5-8b00-8932ab2cc384 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:39:07.514984 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-aa1eaaab-ccdf-45b5-8b00-8932ab2cc384 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1267 microversion: 2.1 time: 0.151233 May 13 17:39:07.515883 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 742/1464] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:39:07 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:39:08.534554 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-6f825c3c-7b61-4027-ad10-ab1c1c61ca9a tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:39:08.535185 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-6f825c3c-7b61-4027-ad10-ab1c1c61ca9a tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:39:08.541580 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6f825c3c-7b61-4027-ad10-ab1c1c61ca9a tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:08.542027 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6f825c3c-7b61-4027-ad10-ab1c1c61ca9a tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:08.542792 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6f825c3c-7b61-4027-ad10-ab1c1c61ca9a tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:08.543249 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-6f825c3c-7b61-4027-ad10-ab1c1c61ca9a tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:08.697521 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-6f825c3c-7b61-4027-ad10-ab1c1c61ca9a tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:39:08.704989 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-6f825c3c-7b61-4027-ad10-ab1c1c61ca9a tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1267 microversion: 2.1 time: 0.174271 May 13 17:39:08.705561 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 723/1465] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:39:08 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1267 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:39:09.721801 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-7ac87c93-be17-4d97-9c1e-bcb0f7c40e7d tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:39:09.722410 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-7ac87c93-be17-4d97-9c1e-bcb0f7c40e7d tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:39:09.728271 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7ac87c93-be17-4d97-9c1e-bcb0f7c40e7d tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:09.728722 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7ac87c93-be17-4d97-9c1e-bcb0f7c40e7d tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:09.733524 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7ac87c93-be17-4d97-9c1e-bcb0f7c40e7d tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:09.733524 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-7ac87c93-be17-4d97-9c1e-bcb0f7c40e7d tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:09.855958 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-7ac87c93-be17-4d97-9c1e-bcb0f7c40e7d tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:39:09.863172 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-7ac87c93-be17-4d97-9c1e-bcb0f7c40e7d tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1267 microversion: 2.1 time: 0.145291 May 13 17:39:09.863858 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 743/1466] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:39:09 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:39:10.880001 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-89601cf7-c877-41dc-801e-1031018b4795 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:39:10.880615 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-89601cf7-c877-41dc-801e-1031018b4795 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:39:10.887523 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-89601cf7-c877-41dc-801e-1031018b4795 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:10.887978 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-89601cf7-c877-41dc-801e-1031018b4795 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:10.888780 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-89601cf7-c877-41dc-801e-1031018b4795 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:10.889225 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-89601cf7-c877-41dc-801e-1031018b4795 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:11.021146 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-89601cf7-c877-41dc-801e-1031018b4795 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:39:11.029244 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-89601cf7-c877-41dc-801e-1031018b4795 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1267 microversion: 2.1 time: 0.153055 May 13 17:39:11.029818 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 724/1467] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:39:10 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:39:12.046692 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8f3265c1-f81b-4f8f-8d8f-a64218281f02 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:39:12.047267 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8f3265c1-f81b-4f8f-8d8f-a64218281f02 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:39:12.053568 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8f3265c1-f81b-4f8f-8d8f-a64218281f02 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:12.054021 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8f3265c1-f81b-4f8f-8d8f-a64218281f02 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:12.054793 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8f3265c1-f81b-4f8f-8d8f-a64218281f02 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:12.055269 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8f3265c1-f81b-4f8f-8d8f-a64218281f02 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:12.193195 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8f3265c1-f81b-4f8f-8d8f-a64218281f02 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:39:12.201100 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8f3265c1-f81b-4f8f-8d8f-a64218281f02 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1267 microversion: 2.1 time: 0.158386 May 13 17:39:12.201667 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 744/1468] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:39:12 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:39:13.217759 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-83108fc1-9a72-445f-9745-a91886d1dbc1 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:39:13.218374 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-83108fc1-9a72-445f-9745-a91886d1dbc1 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:39:13.224761 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-83108fc1-9a72-445f-9745-a91886d1dbc1 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:13.225216 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-83108fc1-9a72-445f-9745-a91886d1dbc1 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:13.226527 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-83108fc1-9a72-445f-9745-a91886d1dbc1 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:13.226971 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-83108fc1-9a72-445f-9745-a91886d1dbc1 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:13.356983 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-83108fc1-9a72-445f-9745-a91886d1dbc1 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:39:13.364396 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-83108fc1-9a72-445f-9745-a91886d1dbc1 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1453 microversion: 2.1 time: 0.150523 May 13 17:39:13.364970 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 725/1469] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:39:13 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:39:13.381059 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-64cc9554-8baa-4add-b8e7-5ecd239b92da tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:39:13.381673 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-64cc9554-8baa-4add-b8e7-5ecd239b92da tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:39:13.388024 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-64cc9554-8baa-4add-b8e7-5ecd239b92da tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:13.388476 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-64cc9554-8baa-4add-b8e7-5ecd239b92da tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:13.389246 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-64cc9554-8baa-4add-b8e7-5ecd239b92da tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:13.389684 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-64cc9554-8baa-4add-b8e7-5ecd239b92da tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:13.518595 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-64cc9554-8baa-4add-b8e7-5ecd239b92da tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:39:13.526437 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-64cc9554-8baa-4add-b8e7-5ecd239b92da tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1453 microversion: 2.1 time: 0.149133 May 13 17:39:13.527015 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 745/1470] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:39:13 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1453 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:39:15.912992 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-38f16a45-1f99-43d3-af3e-f707eeef295b req-4c19288e-834c-443f-99c4-edbed3d1d9eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89b80358-f455-40eb-9c58-8246a0f5e874", "tag": "145b3c79-f4a4-4cce-a4f7-e4034da0c4e2"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:39:15.932335 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-38f16a45-1f99-43d3-af3e-f707eeef295b req-4c19288e-834c-443f-99c4-edbed3d1d9eb service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:39:15.932335 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-38f16a45-1f99-43d3-af3e-f707eeef295b req-4c19288e-834c-443f-99c4-edbed3d1d9eb service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:39:15.947553 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-38f16a45-1f99-43d3-af3e-f707eeef295b req-4c19288e-834c-443f-99c4-edbed3d1d9eb service nova] Creating event network-changed:145b3c79-f4a4-4cce-a4f7-e4034da0c4e2 for instance 89b80358-f455-40eb-9c58-8246a0f5e874 on hv-cinder-84178 May 13 17:39:15.954988 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-38f16a45-1f99-43d3-af3e-f707eeef295b req-4c19288e-834c-443f-99c4-edbed3d1d9eb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.214377 May 13 17:39:15.959701 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 726/1471] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:39:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:40:11.248463 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 17:40:11.248966 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Fri May 13 17:40:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 17:41:38.123794 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12fea7dc-6d13-4b31-9e83-4f24b51e7280] AMQP server on 10.222.0.64:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: May 13 17:41:38.128350 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b0df116a-86cb-4abf-8e8e-884217d8fba1 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1248089167", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1402304854", "security_groups": [{"name": "tempest-secgroup-smoke-2107664403"}], "block_device_mapping_v2": [{"uuid": "39f11963-c3e3-4a55-ba4f-d4d84f7f8c1f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9bc3da8d-37aa-4c42-a26a-ff8ce273072b"}]}} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:41:38.238148 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.network.neutron [None req-b0df116a-86cb-4abf-8e8e-884217d8fba1 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] validate_networks() for [('9bc3da8d-37aa-4c42-a26a-ff8ce273072b', None, None, None, None, None)] {{(pid=117493) validate_networks /opt/stack/nova/nova/network/neutron.py:2608}} May 13 17:41:38.718570 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-b0df116a-86cb-4abf-8e8e-884217d8fba1 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Flavor limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 13 17:41:38.718997 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-b0df116a-86cb-4abf-8e8e-884217d8fba1 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Image limits 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 13 17:41:38.719510 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-b0df116a-86cb-4abf-8e8e-884217d8fba1 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Flavor pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 13 17:41:38.720614 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-b0df116a-86cb-4abf-8e8e-884217d8fba1 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Image pref 0:0:0 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 13 17:41:38.721029 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.virt.hardware [None req-b0df116a-86cb-4abf-8e8e-884217d8fba1 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117493) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 13 17:41:38.729980 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b0df116a-86cb-4abf-8e8e-884217d8fba1 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:38.730496 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b0df116a-86cb-4abf-8e8e-884217d8fba1 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:38.731348 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b0df116a-86cb-4abf-8e8e-884217d8fba1 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:38.731791 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b0df116a-86cb-4abf-8e8e-884217d8fba1 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:38.748348 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-b0df116a-86cb-4abf-8e8e-884217d8fba1 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Getting quotas for project 60fd06693c624da5aa61222dfbde5b25. Resources: {'ram', 'instances', 'cores'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 13 17:41:38.753077 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.quota [None req-b0df116a-86cb-4abf-8e8e-884217d8fba1 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Getting quotas for user 45482c562be6438ebd456ee9512ef3e8 and project 60fd06693c624da5aa61222dfbde5b25. Resources: {'ram', 'instances', 'cores'} {{(pid=117493) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 13 17:41:38.808121 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b0df116a-86cb-4abf-8e8e-884217d8fba1 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Going to run 1 instances... {{(pid=117493) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 13 17:41:38.810366 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b0df116a-86cb-4abf-8e8e-884217d8fba1 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='39f11963-c3e3-4a55-ba4f-d4d84f7f8c1f',volume_size=None,volume_type=None)] {{(pid=117493) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 13 17:41:39.131703 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO oslo.messaging._drivers.impl_rabbit [-] [12fea7dc-6d13-4b31-9e83-4f24b51e7280] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 47292. May 13 17:41:39.180731 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b0df116a-86cb-4abf-8e8e-884217d8fba1 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [55471473-47dd-4539-8fcc-8d09668b688e] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 13 17:41:40.187536 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO oslo.messaging._drivers.impl_rabbit [None req-b0df116a-86cb-4abf-8e8e-884217d8fba1 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [55471473-47dd-4539-8fcc-8d09668b688e] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 47300. May 13 17:41:40.191857 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b0df116a-86cb-4abf-8e8e-884217d8fba1 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.069823 May 13 17:41:40.192572 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 746/1472] 10.222.0.64 () {60 vars in 1146 bytes} [Fri May 13 17:41:38 2022] POST /compute/v2.1/servers => generated 406 bytes in 2071 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 13 17:41:40.200914 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR oslo.messaging._drivers.impl_rabbit [-] [1944ed35-5170-49b3-9460-15b20d512e63] AMQP server on 10.222.0.64:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 13 17:41:40.206388 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7d59b66f-7b07-420d-b713-5cedfe63c3b3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:41:40.207147 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7d59b66f-7b07-420d-b713-5cedfe63c3b3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:41:40.381095 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7d59b66f-7b07-420d-b713-5cedfe63c3b3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:41:40.387657 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7d59b66f-7b07-420d-b713-5cedfe63c3b3 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18" status: 200 len: 1095 microversion: 2.1 time: 0.188711 May 13 17:41:40.388212 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 727/1473] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:41:40 2022] GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18 => generated 1095 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:41:41.405484 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2f48bd1b-9f1b-46a7-ac89-2d01a3aeb89a tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:41:41.406112 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2f48bd1b-9f1b-46a7-ac89-2d01a3aeb89a tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:41:41.412907 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2f48bd1b-9f1b-46a7-ac89-2d01a3aeb89a tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:41.424905 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2f48bd1b-9f1b-46a7-ac89-2d01a3aeb89a tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:41.424905 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2f48bd1b-9f1b-46a7-ac89-2d01a3aeb89a tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:41.424905 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2f48bd1b-9f1b-46a7-ac89-2d01a3aeb89a tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:41.524762 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2f48bd1b-9f1b-46a7-ac89-2d01a3aeb89a tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:41:41.532012 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2f48bd1b-9f1b-46a7-ac89-2d01a3aeb89a tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18" status: 200 len: 1137 microversion: 2.1 time: 0.131006 May 13 17:41:41.533185 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 747/1474] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:41:41 2022] GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18 => generated 1137 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:41:42.554279 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-d1301ae6-489e-4fe3-91de-3394edb8ce7b tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:41:42.554995 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-d1301ae6-489e-4fe3-91de-3394edb8ce7b tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:41:42.563173 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d1301ae6-489e-4fe3-91de-3394edb8ce7b tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:42.564286 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d1301ae6-489e-4fe3-91de-3394edb8ce7b tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:42.565080 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d1301ae6-489e-4fe3-91de-3394edb8ce7b tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:42.565523 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-d1301ae6-489e-4fe3-91de-3394edb8ce7b tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:42.572346 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO oslo.messaging._drivers.impl_rabbit [-] [1944ed35-5170-49b3-9460-15b20d512e63] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 47336. May 13 17:41:42.652035 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-d1301ae6-489e-4fe3-91de-3394edb8ce7b tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:41:42.659479 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-d1301ae6-489e-4fe3-91de-3394edb8ce7b tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18" status: 200 len: 1211 microversion: 2.1 time: 0.112563 May 13 17:41:42.660053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 728/1475] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:41:42 2022] GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18 => generated 1211 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:41:43.677112 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-62ec9745-548c-4a7f-a9c1-53d10ddfc2c4 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:41:43.678471 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-62ec9745-548c-4a7f-a9c1-53d10ddfc2c4 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:41:43.707764 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-62ec9745-548c-4a7f-a9c1-53d10ddfc2c4 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:43.708574 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-62ec9745-548c-4a7f-a9c1-53d10ddfc2c4 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:43.709601 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-62ec9745-548c-4a7f-a9c1-53d10ddfc2c4 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:43.711994 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-62ec9745-548c-4a7f-a9c1-53d10ddfc2c4 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:43.869941 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-62ec9745-548c-4a7f-a9c1-53d10ddfc2c4 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:41:43.879273 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-62ec9745-548c-4a7f-a9c1-53d10ddfc2c4 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18" status: 200 len: 1279 microversion: 2.1 time: 0.206769 May 13 17:41:43.888376 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 748/1476] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:41:43 2022] GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18 => generated 1279 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:41:43.917798 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-661f863b-229a-4d7b-9b1c-80b290b756e5 req-48f51688-c178-45db-90ac-c753864b594f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dd7a84a-b05b-4644-83ab-ab19772c2d18", "tag": "0456827d-a13d-4097-a1eb-38b2f76c1106"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:41:43.930643 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-661f863b-229a-4d7b-9b1c-80b290b756e5 req-48f51688-c178-45db-90ac-c753864b594f service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:43.931099 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-661f863b-229a-4d7b-9b1c-80b290b756e5 req-48f51688-c178-45db-90ac-c753864b594f service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:43.943476 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-661f863b-229a-4d7b-9b1c-80b290b756e5 req-48f51688-c178-45db-90ac-c753864b594f service nova] Creating event network-changed:0456827d-a13d-4097-a1eb-38b2f76c1106 for instance 9dd7a84a-b05b-4644-83ab-ab19772c2d18 on hv-cinder-84178 May 13 17:41:43.946936 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR oslo.messaging._drivers.impl_rabbit [req-661f863b-229a-4d7b-9b1c-80b290b756e5 req-48f51688-c178-45db-90ac-c753864b594f service nova] [d6282e81-86e3-4720-89f0-639593307727] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 13 17:41:44.896669 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-90118e6c-18ce-4b7b-a1a5-6e40bf683442 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:41:44.897299 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-90118e6c-18ce-4b7b-a1a5-6e40bf683442 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:41:44.903538 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-90118e6c-18ce-4b7b-a1a5-6e40bf683442 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:44.903982 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-90118e6c-18ce-4b7b-a1a5-6e40bf683442 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:44.904736 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-90118e6c-18ce-4b7b-a1a5-6e40bf683442 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:44.905164 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-90118e6c-18ce-4b7b-a1a5-6e40bf683442 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:44.956441 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO oslo.messaging._drivers.impl_rabbit [req-661f863b-229a-4d7b-9b1c-80b290b756e5 req-48f51688-c178-45db-90ac-c753864b594f service nova] [d6282e81-86e3-4720-89f0-639593307727] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 47358. May 13 17:41:44.960679 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-661f863b-229a-4d7b-9b1c-80b290b756e5 req-48f51688-c178-45db-90ac-c753864b594f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.047054 May 13 17:41:44.961412 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 729/1477] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:41:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:41:45.031870 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-90118e6c-18ce-4b7b-a1a5-6e40bf683442 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:41:45.038999 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-90118e6c-18ce-4b7b-a1a5-6e40bf683442 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18" status: 200 len: 1267 microversion: 2.1 time: 0.146231 May 13 17:41:45.039587 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 749/1478] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:41:44 2022] GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 13 17:41:45.503324 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 17:41:45.503598 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Fri May 13 17:41:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 17:41:46.056101 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7af7d211-ddf5-4f80-afff-bfbbfc2d0378 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:41:46.056839 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7af7d211-ddf5-4f80-afff-bfbbfc2d0378 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:41:46.062924 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7af7d211-ddf5-4f80-afff-bfbbfc2d0378 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:46.063415 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7af7d211-ddf5-4f80-afff-bfbbfc2d0378 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:46.064193 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7af7d211-ddf5-4f80-afff-bfbbfc2d0378 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:46.064632 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7af7d211-ddf5-4f80-afff-bfbbfc2d0378 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:46.198799 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-7af7d211-ddf5-4f80-afff-bfbbfc2d0378 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:41:46.208592 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7af7d211-ddf5-4f80-afff-bfbbfc2d0378 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18" status: 200 len: 1267 microversion: 2.1 time: 0.156560 May 13 17:41:46.209554 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 730/1479] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:41:46 2022] GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18 => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:41:47.225871 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-94fd7181-a85c-40c6-84f5-f90a2cd917b7 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:41:47.281840 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-94fd7181-a85c-40c6-84f5-f90a2cd917b7 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:41:47.281840 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-94fd7181-a85c-40c6-84f5-f90a2cd917b7 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:47.281840 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-94fd7181-a85c-40c6-84f5-f90a2cd917b7 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:47.281840 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-94fd7181-a85c-40c6-84f5-f90a2cd917b7 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:47.282287 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-94fd7181-a85c-40c6-84f5-f90a2cd917b7 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:47.363895 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-94fd7181-a85c-40c6-84f5-f90a2cd917b7 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:41:47.371065 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-94fd7181-a85c-40c6-84f5-f90a2cd917b7 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18" status: 200 len: 1267 microversion: 2.1 time: 0.149194 May 13 17:41:47.371664 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 750/1480] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:41:47 2022] GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:41:48.388361 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-2b3ba352-3959-472a-902b-2cb6be5ce2ac tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:41:48.388975 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-2b3ba352-3959-472a-902b-2cb6be5ce2ac tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:41:48.395324 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2b3ba352-3959-472a-902b-2cb6be5ce2ac tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:48.395786 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2b3ba352-3959-472a-902b-2cb6be5ce2ac tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:48.396557 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2b3ba352-3959-472a-902b-2cb6be5ce2ac tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:48.397003 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-2b3ba352-3959-472a-902b-2cb6be5ce2ac tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:48.523342 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-2b3ba352-3959-472a-902b-2cb6be5ce2ac tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:41:48.530577 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-2b3ba352-3959-472a-902b-2cb6be5ce2ac tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18" status: 200 len: 1267 microversion: 2.1 time: 0.146065 May 13 17:41:48.531172 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 731/1481] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:41:48 2022] GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18 => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:41:49.547837 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-35abe8dd-40ab-44a5-8213-f1ebb8339e47 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:41:49.548447 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-35abe8dd-40ab-44a5-8213-f1ebb8339e47 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:41:49.554755 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-35abe8dd-40ab-44a5-8213-f1ebb8339e47 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:49.555241 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-35abe8dd-40ab-44a5-8213-f1ebb8339e47 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:49.556014 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-35abe8dd-40ab-44a5-8213-f1ebb8339e47 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:49.556458 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-35abe8dd-40ab-44a5-8213-f1ebb8339e47 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:49.682635 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-35abe8dd-40ab-44a5-8213-f1ebb8339e47 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:41:49.690447 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-35abe8dd-40ab-44a5-8213-f1ebb8339e47 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18" status: 200 len: 1267 microversion: 2.1 time: 0.146451 May 13 17:41:49.691028 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 751/1482] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:41:49 2022] GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:41:50.707611 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-0f837751-23c4-4234-ae2c-b0a8604aacab tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:41:50.708281 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-0f837751-23c4-4234-ae2c-b0a8604aacab tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:41:50.714572 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0f837751-23c4-4234-ae2c-b0a8604aacab tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:50.715026 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0f837751-23c4-4234-ae2c-b0a8604aacab tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:50.715832 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0f837751-23c4-4234-ae2c-b0a8604aacab tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:50.716271 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-0f837751-23c4-4234-ae2c-b0a8604aacab tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:50.845794 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-0f837751-23c4-4234-ae2c-b0a8604aacab tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:41:50.852990 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-0f837751-23c4-4234-ae2c-b0a8604aacab tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18" status: 200 len: 1267 microversion: 2.1 time: 0.149828 May 13 17:41:50.853548 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 732/1483] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:41:50 2022] GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:41:51.869735 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8939ed0d-446e-44c2-a37b-f2a9bcb7eac9 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:41:51.870350 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8939ed0d-446e-44c2-a37b-f2a9bcb7eac9 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:41:51.877194 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8939ed0d-446e-44c2-a37b-f2a9bcb7eac9 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:51.877691 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8939ed0d-446e-44c2-a37b-f2a9bcb7eac9 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:51.878469 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8939ed0d-446e-44c2-a37b-f2a9bcb7eac9 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:51.878908 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8939ed0d-446e-44c2-a37b-f2a9bcb7eac9 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:52.013285 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8939ed0d-446e-44c2-a37b-f2a9bcb7eac9 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:41:52.020528 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8939ed0d-446e-44c2-a37b-f2a9bcb7eac9 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18" status: 200 len: 1267 microversion: 2.1 time: 0.154610 May 13 17:41:52.021093 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 752/1484] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:41:51 2022] GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18 => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:41:52.790293 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 17:41:52.790867 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Fri May 13 17:41:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 17:41:53.037230 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-64453a75-678c-48b2-86fa-f697444db7f5 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:41:53.037844 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-64453a75-678c-48b2-86fa-f697444db7f5 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:41:53.044317 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-64453a75-678c-48b2-86fa-f697444db7f5 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:53.044712 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-64453a75-678c-48b2-86fa-f697444db7f5 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:53.045484 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-64453a75-678c-48b2-86fa-f697444db7f5 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:53.045925 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-64453a75-678c-48b2-86fa-f697444db7f5 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:53.172464 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-64453a75-678c-48b2-86fa-f697444db7f5 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:41:53.179842 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-64453a75-678c-48b2-86fa-f697444db7f5 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18" status: 200 len: 1267 microversion: 2.1 time: 0.146494 May 13 17:41:53.180409 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 733/1485] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:41:53 2022] GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:41:54.197182 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-cd061ec7-463e-43da-bf88-fd637b131399 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:41:54.197781 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-cd061ec7-463e-43da-bf88-fd637b131399 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:41:54.204626 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cd061ec7-463e-43da-bf88-fd637b131399 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:54.205066 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cd061ec7-463e-43da-bf88-fd637b131399 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:54.205816 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cd061ec7-463e-43da-bf88-fd637b131399 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:54.206245 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-cd061ec7-463e-43da-bf88-fd637b131399 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:54.330330 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-cd061ec7-463e-43da-bf88-fd637b131399 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:41:54.337600 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-cd061ec7-463e-43da-bf88-fd637b131399 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18" status: 200 len: 1267 microversion: 2.1 time: 0.144244 May 13 17:41:54.338168 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 753/1486] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:41:54 2022] GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18 => generated 1267 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:41:55.354764 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-4bddfa4f-63cd-4f8c-b582-b95df2da0d09 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:41:55.355905 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-4bddfa4f-63cd-4f8c-b582-b95df2da0d09 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:41:55.362456 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4bddfa4f-63cd-4f8c-b582-b95df2da0d09 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:55.362902 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4bddfa4f-63cd-4f8c-b582-b95df2da0d09 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:55.363705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4bddfa4f-63cd-4f8c-b582-b95df2da0d09 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:55.364142 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-4bddfa4f-63cd-4f8c-b582-b95df2da0d09 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:55.493289 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-4bddfa4f-63cd-4f8c-b582-b95df2da0d09 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:41:55.500483 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-4bddfa4f-63cd-4f8c-b582-b95df2da0d09 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18" status: 200 len: 1267 microversion: 2.1 time: 0.149679 May 13 17:41:55.501565 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 734/1487] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:41:55 2022] GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:41:56.518111 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-df3d57d6-24ba-4ce7-bdc3-4f7ab7b483db tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:41:56.518726 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-df3d57d6-24ba-4ce7-bdc3-4f7ab7b483db tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:41:56.525147 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-df3d57d6-24ba-4ce7-bdc3-4f7ab7b483db tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:56.525604 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-df3d57d6-24ba-4ce7-bdc3-4f7ab7b483db tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:56.526419 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-df3d57d6-24ba-4ce7-bdc3-4f7ab7b483db tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:56.526863 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-df3d57d6-24ba-4ce7-bdc3-4f7ab7b483db tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:56.668527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-df3d57d6-24ba-4ce7-bdc3-4f7ab7b483db tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:41:56.673876 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-df3d57d6-24ba-4ce7-bdc3-4f7ab7b483db tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18" status: 200 len: 1267 microversion: 2.1 time: 0.159857 May 13 17:41:56.674545 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 754/1488] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:41:56 2022] GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18 => generated 1267 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:41:56.692127 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-fa4a7904-274c-4589-bfe3-ee4f44e41e4e req-9badea1f-6ad0-4651-9a2a-43a7242c6155 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dd7a84a-b05b-4644-83ab-ab19772c2d18", "name": "network-vif-plugged", "status": "completed", "tag": "0456827d-a13d-4097-a1eb-38b2f76c1106"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:41:56.700581 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-fa4a7904-274c-4589-bfe3-ee4f44e41e4e req-9badea1f-6ad0-4651-9a2a-43a7242c6155 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:56.701025 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-fa4a7904-274c-4589-bfe3-ee4f44e41e4e req-9badea1f-6ad0-4651-9a2a-43a7242c6155 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:56.712468 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-fa4a7904-274c-4589-bfe3-ee4f44e41e4e req-9badea1f-6ad0-4651-9a2a-43a7242c6155 service nova] Creating event network-vif-plugged:0456827d-a13d-4097-a1eb-38b2f76c1106 for instance 9dd7a84a-b05b-4644-83ab-ab19772c2d18 on hv-cinder-84178 May 13 17:41:56.717562 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-fa4a7904-274c-4589-bfe3-ee4f44e41e4e req-9badea1f-6ad0-4651-9a2a-43a7242c6155 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028997 May 13 17:41:56.718161 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 735/1489] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:41:57.691783 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-27435b3f-11fc-4fbc-bb84-c3b820789709 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:41:57.692390 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-27435b3f-11fc-4fbc-bb84-c3b820789709 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:41:57.698573 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-27435b3f-11fc-4fbc-bb84-c3b820789709 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:57.699017 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-27435b3f-11fc-4fbc-bb84-c3b820789709 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:57.699804 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-27435b3f-11fc-4fbc-bb84-c3b820789709 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:57.700235 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-27435b3f-11fc-4fbc-bb84-c3b820789709 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:57.824746 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-27435b3f-11fc-4fbc-bb84-c3b820789709 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:41:57.832594 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-27435b3f-11fc-4fbc-bb84-c3b820789709 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18" status: 200 len: 1267 microversion: 2.1 time: 0.145540 May 13 17:41:57.833159 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 755/1490] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:41:57 2022] GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18 => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:41:58.850318 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-c5dd0df5-79a1-46c3-b8f9-3a79dfdea272 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:41:58.851021 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-c5dd0df5-79a1-46c3-b8f9-3a79dfdea272 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:41:58.857585 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c5dd0df5-79a1-46c3-b8f9-3a79dfdea272 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:58.858288 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c5dd0df5-79a1-46c3-b8f9-3a79dfdea272 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:58.859048 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c5dd0df5-79a1-46c3-b8f9-3a79dfdea272 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:41:58.859510 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-c5dd0df5-79a1-46c3-b8f9-3a79dfdea272 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:41:58.991695 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-c5dd0df5-79a1-46c3-b8f9-3a79dfdea272 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:41:58.999053 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-c5dd0df5-79a1-46c3-b8f9-3a79dfdea272 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18" status: 200 len: 1267 microversion: 2.1 time: 0.152942 May 13 17:41:58.999651 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 736/1491] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:41:58 2022] GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18 => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:42:00.016297 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-1b687551-6bda-4b60-af95-21ac1bd84fce tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:42:00.017503 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-1b687551-6bda-4b60-af95-21ac1bd84fce tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:42:00.023978 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1b687551-6bda-4b60-af95-21ac1bd84fce tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:42:00.024435 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1b687551-6bda-4b60-af95-21ac1bd84fce tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:42:00.025206 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1b687551-6bda-4b60-af95-21ac1bd84fce tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:42:00.025647 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-1b687551-6bda-4b60-af95-21ac1bd84fce tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:42:00.152009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-1b687551-6bda-4b60-af95-21ac1bd84fce tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:42:00.159354 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-1b687551-6bda-4b60-af95-21ac1bd84fce tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18" status: 200 len: 1454 microversion: 2.1 time: 0.146856 May 13 17:42:00.159930 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 756/1492] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:42:00 2022] GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18 => generated 1454 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:42:00.175774 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-ba923648-efd2-4672-9f10-6dcbc2297002 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:42:00.176407 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-ba923648-efd2-4672-9f10-6dcbc2297002 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:42:00.182628 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ba923648-efd2-4672-9f10-6dcbc2297002 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:42:00.183077 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ba923648-efd2-4672-9f10-6dcbc2297002 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:42:00.183864 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ba923648-efd2-4672-9f10-6dcbc2297002 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:42:00.184297 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-ba923648-efd2-4672-9f10-6dcbc2297002 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:42:00.317184 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-ba923648-efd2-4672-9f10-6dcbc2297002 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:42:00.324510 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-ba923648-efd2-4672-9f10-6dcbc2297002 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18" status: 200 len: 1454 microversion: 2.1 time: 0.153112 May 13 17:42:00.325071 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 737/1493] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:42:00 2022] GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:42:02.595556 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-9f030947-384f-4a51-84b1-74c14756a610 req-3d4c7368-19f9-47e2-ace6-ee035f23135c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dd7a84a-b05b-4644-83ab-ab19772c2d18", "tag": "0456827d-a13d-4097-a1eb-38b2f76c1106"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:42:02.603922 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-9f030947-384f-4a51-84b1-74c14756a610 req-3d4c7368-19f9-47e2-ace6-ee035f23135c service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:42:02.604366 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-9f030947-384f-4a51-84b1-74c14756a610 req-3d4c7368-19f9-47e2-ace6-ee035f23135c service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:42:02.615385 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-9f030947-384f-4a51-84b1-74c14756a610 req-3d4c7368-19f9-47e2-ace6-ee035f23135c service nova] Creating event network-changed:0456827d-a13d-4097-a1eb-38b2f76c1106 for instance 9dd7a84a-b05b-4644-83ab-ab19772c2d18 on hv-cinder-84178 May 13 17:42:02.618853 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR oslo.messaging._drivers.impl_rabbit [req-9f030947-384f-4a51-84b1-74c14756a610 req-3d4c7368-19f9-47e2-ace6-ee035f23135c service nova] [9a8dfbd3-6cf0-48af-bfb1-dfcdddc3681a] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 13 17:42:03.627792 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO oslo.messaging._drivers.impl_rabbit [req-9f030947-384f-4a51-84b1-74c14756a610 req-3d4c7368-19f9-47e2-ace6-ee035f23135c service nova] [9a8dfbd3-6cf0-48af-bfb1-dfcdddc3681a] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 47412. May 13 17:42:03.632388 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-9f030947-384f-4a51-84b1-74c14756a610 req-3d4c7368-19f9-47e2-ace6-ee035f23135c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.040829 May 13 17:42:03.633038 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 757/1494] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:42:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:43:31.256943 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 17:43:31.257646 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Fri May 13 17:43:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 17:43:53.793417 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-3c232682-534c-4e09-a579-8b0258137500 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:43:53.793980 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR oslo.messaging._drivers.impl_rabbit [-] [12fea7dc-6d13-4b31-9e83-4f24b51e7280] AMQP server on 10.222.0.64:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 13 17:43:53.794353 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3c232682-534c-4e09-a579-8b0258137500 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:43:53.800243 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3c232682-534c-4e09-a579-8b0258137500 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:43:53.800871 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3c232682-534c-4e09-a579-8b0258137500 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:43:53.801528 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3c232682-534c-4e09-a579-8b0258137500 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:43:53.801979 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-3c232682-534c-4e09-a579-8b0258137500 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:43:53.827318 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-3c232682-534c-4e09-a579-8b0258137500 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] Going to try to terminate instance {{(pid=117492) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 17:43:53.924605 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [req-22bf78a6-19d9-44e2-9c44-5f585517467a req-9d8f6d2c-13d0-4c94-8e90-592850cb2937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9dd7a84a-b05b-4644-83ab-ab19772c2d18", "tag": "0456827d-a13d-4097-a1eb-38b2f76c1106"}]} {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:43:53.934561 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-22bf78a6-19d9-44e2-9c44-5f585517467a req-9d8f6d2c-13d0-4c94-8e90-592850cb2937 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:43:53.935100 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [req-22bf78a6-19d9-44e2-9c44-5f585517467a req-9d8f6d2c-13d0-4c94-8e90-592850cb2937 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:43:53.946106 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.compute.server_external_events [req-22bf78a6-19d9-44e2-9c44-5f585517467a req-9d8f6d2c-13d0-4c94-8e90-592850cb2937 service nova] Creating event network-changed:0456827d-a13d-4097-a1eb-38b2f76c1106 for instance 9dd7a84a-b05b-4644-83ab-ab19772c2d18 on hv-cinder-84178 May 13 17:43:53.951267 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [req-22bf78a6-19d9-44e2-9c44-5f585517467a req-9d8f6d2c-13d0-4c94-8e90-592850cb2937 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161288 May 13 17:43:53.954729 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 758/1495] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:43:54.095473 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-3c232682-534c-4e09-a579-8b0258137500 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "DELETE /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18" status: 204 len: 0 microversion: 2.1 time: 0.307432 May 13 17:43:54.096652 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 738/1496] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:43:53 2022] DELETE /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 17:43:54.106242 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-b62c1dcf-3e35-4a80-b91a-98a3a7bac547 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:43:54.107185 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-b62c1dcf-3e35-4a80-b91a-98a3a7bac547 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:43:54.114247 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b62c1dcf-3e35-4a80-b91a-98a3a7bac547 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:43:54.114837 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b62c1dcf-3e35-4a80-b91a-98a3a7bac547 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:43:54.115833 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b62c1dcf-3e35-4a80-b91a-98a3a7bac547 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:43:54.116631 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-b62c1dcf-3e35-4a80-b91a-98a3a7bac547 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:43:54.249937 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-b62c1dcf-3e35-4a80-b91a-98a3a7bac547 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:43:54.257275 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-b62c1dcf-3e35-4a80-b91a-98a3a7bac547 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18" status: 200 len: 1579 microversion: 2.1 time: 0.156120 May 13 17:43:54.257841 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 759/1497] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:43:54 2022] GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18 => generated 1579 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:43:55.277868 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-5f9ebcda-0115-4360-b277-f3a0df1d3519 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:43:55.278575 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-5f9ebcda-0115-4360-b277-f3a0df1d3519 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:43:55.285418 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5f9ebcda-0115-4360-b277-f3a0df1d3519 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:43:55.285617 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5f9ebcda-0115-4360-b277-f3a0df1d3519 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:43:55.286265 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5f9ebcda-0115-4360-b277-f3a0df1d3519 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:43:55.286715 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-5f9ebcda-0115-4360-b277-f3a0df1d3519 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:43:55.434258 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-5f9ebcda-0115-4360-b277-f3a0df1d3519 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:43:55.441810 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-5f9ebcda-0115-4360-b277-f3a0df1d3519 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18" status: 200 len: 1579 microversion: 2.1 time: 0.168915 May 13 17:43:55.442379 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 739/1498] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:43:55 2022] GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18 => generated 1579 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:43:56.460064 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8914cc05-d448-4ad5-9554-3204e4850916 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:43:56.460672 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8914cc05-d448-4ad5-9554-3204e4850916 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:43:56.469104 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8914cc05-d448-4ad5-9554-3204e4850916 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:43:56.469555 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8914cc05-d448-4ad5-9554-3204e4850916 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:43:56.470333 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8914cc05-d448-4ad5-9554-3204e4850916 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:43:56.470795 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8914cc05-d448-4ad5-9554-3204e4850916 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:43:56.476030 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO oslo.messaging._drivers.impl_rabbit [-] [12fea7dc-6d13-4b31-9e83-4f24b51e7280] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 47462. May 13 17:43:56.698745 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8914cc05-d448-4ad5-9554-3204e4850916 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:43:56.706061 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8914cc05-d448-4ad5-9554-3204e4850916 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18" status: 200 len: 1579 microversion: 2.1 time: 0.250010 May 13 17:43:56.706620 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 760/1499] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:43:56 2022] GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18 => generated 1579 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:43:57.008717 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-829e8fe5-af68-45bc-a48d-dda094f4dd3e req-c183d08c-6b44-45d7-afa1-ca458aaa2c58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9dd7a84a-b05b-4644-83ab-ab19772c2d18", "name": "network-vif-deleted", "tag": "0456827d-a13d-4097-a1eb-38b2f76c1106"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:43:57.017444 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-829e8fe5-af68-45bc-a48d-dda094f4dd3e req-c183d08c-6b44-45d7-afa1-ca458aaa2c58 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:43:57.020986 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-829e8fe5-af68-45bc-a48d-dda094f4dd3e req-c183d08c-6b44-45d7-afa1-ca458aaa2c58 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:43:57.029136 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-829e8fe5-af68-45bc-a48d-dda094f4dd3e req-c183d08c-6b44-45d7-afa1-ca458aaa2c58 service nova] Creating event network-vif-deleted:0456827d-a13d-4097-a1eb-38b2f76c1106 for instance 9dd7a84a-b05b-4644-83ab-ab19772c2d18 on hv-cinder-84178 May 13 17:43:57.033988 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-829e8fe5-af68-45bc-a48d-dda094f4dd3e req-c183d08c-6b44-45d7-afa1-ca458aaa2c58 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028921 May 13 17:43:57.034565 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 740/1500] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:43:57.723327 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-8c93eacb-bff2-4c8b-9cd7-682b8b745abe tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:43:57.723876 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-8c93eacb-bff2-4c8b-9cd7-682b8b745abe tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:43:57.730100 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8c93eacb-bff2-4c8b-9cd7-682b8b745abe tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:43:57.730540 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8c93eacb-bff2-4c8b-9cd7-682b8b745abe tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:43:57.731329 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8c93eacb-bff2-4c8b-9cd7-682b8b745abe tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:43:57.733345 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-8c93eacb-bff2-4c8b-9cd7-682b8b745abe tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:43:57.793430 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-8c93eacb-bff2-4c8b-9cd7-682b8b745abe tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:43:57.800870 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-8c93eacb-bff2-4c8b-9cd7-682b8b745abe tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18" status: 200 len: 1226 microversion: 2.1 time: 0.081489 May 13 17:43:57.807918 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 761/1501] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:43:57 2022] GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18 => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:43:58.819426 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-93c8f8b9-a85c-4bd8-a1c8-807e4f1356bf tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:43:58.820046 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-93c8f8b9-a85c-4bd8-a1c8-807e4f1356bf tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 9dd7a84a-b05b-4644-83ab-ab19772c2d18] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:43:58.826689 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-93c8f8b9-a85c-4bd8-a1c8-807e4f1356bf tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:43:58.827151 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-93c8f8b9-a85c-4bd8-a1c8-807e4f1356bf tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:43:58.827932 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-93c8f8b9-a85c-4bd8-a1c8-807e4f1356bf tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:43:58.828380 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-93c8f8b9-a85c-4bd8-a1c8-807e4f1356bf tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:43:58.842022 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-93c8f8b9-a85c-4bd8-a1c8-807e4f1356bf tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] HTTP exception thrown: Instance 9dd7a84a-b05b-4644-83ab-ab19772c2d18 could not be found. May 13 17:43:58.843644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-93c8f8b9-a85c-4bd8-a1c8-807e4f1356bf tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Request method failure captured: May 13 17:43:58.843644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18 HTTP/1.1 May 13 17:43:58.843644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:43:58.843644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:43:58.843644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:43:58.843644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 0 May 13 17:43:58.843644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:43:58.843644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:43:58.843644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:43:58.843644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:43:58.843644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpbIJS0Ge9t1DxCI2iC1Lb6YBjFX9xSuD6l_gEFNAJlxamiQplE07vcLq53y1WIzjIUkO30iIjWLvqh3-lAsVBmwcU_8Ys3w3tLJFKjdxPYj2yKw6_3vD25IxrS2Eid4K6B4Hf0C7Sp2TkdCIY6HRBNcQwG8NDBsE4sNW4AHLY2xLGw May 13 17:43:58.843644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:43:58.843644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:43:58.843644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:43:58.843644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:43:58.843644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:43:58.843644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:43:58.843644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: 60fd06693c624da5aa61222dfbde5b25 May 13 17:43:58.843644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-TestVolumeBootPattern-381584425 May 13 17:43:58.843644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:43:58.843644 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:43:58.845460 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/60fd06693c624da5aa61222dfbde5b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60fd06693c624da5aa61222dfbde5b25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_60fd06693c624da5aa61222dfbde5b25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60fd06693c624da5aa61222dfbde5b25"}]}] May 13 17:43:58.845460 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-TestVolumeBootPattern-381584425 May 13 17:43:58.845460 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: 60fd06693c624da5aa61222dfbde5b25 May 13 17:43:58.845460 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-TestVolumeBootPattern-381584425 May 13 17:43:58.845460 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-TestVolumeBootPattern-381584425-project May 13 17:43:58.845460 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:43:58.845460 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:43:58.845460 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: 45482c562be6438ebd456ee9512ef3e8 May 13 17:43:58.845460 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-TestVolumeBootPattern-381584425-project May 13 17:43:58.845460 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: > May 13 17:43:58.845460 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Instance 9dd7a84a-b05b-4644-83ab-ab19772c2d18 could not be found. May 13 17:43:58.845460 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'id': '9dd7a84a-b05b-4644-83ab-ab19772c2d18'} May 13 17:43:58.846477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:43:58.846477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:43:58.846477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:43:58.846477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:43:58.846477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:43:58.846477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:43:58.846477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:43:58.846477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:43:58.846477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:43:58.846477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:43:58.846477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9dd7a84a-b05b-4644-83ab-ab19772c2d18 could not be found. May 13 17:43:58.846477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:43:58.846477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:43:58.846477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:43:58.846477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:43:58.846477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:43:58.846477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:43:58.846477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:43:58.846477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:43:58.846477 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:43:58.848298 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:43:58.848298 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:43:58.848298 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:43:58.848298 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:43:58.848298 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:43:58.848298 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:43:58.848298 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:43:58.848298 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9dd7a84a-b05b-4644-83ab-ab19772c2d18 could not be found. May 13 17:43:58.848298 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:43:58.848298 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:43:58.848298 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:43:58.848298 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:43:58.848298 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:43:58.848298 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:43:58.848298 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:43:58.848298 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:43:58.848298 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9dd7a84a-b05b-4644-83ab-ab19772c2d18 could not be found. May 13 17:43:58.848298 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:43:58.849797 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-93c8f8b9-a85c-4bd8-a1c8-807e4f1356bf tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Returning 404 to user: Instance 9dd7a84a-b05b-4644-83ab-ab19772c2d18 could not be found. {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:43:58.849797 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-93c8f8b9-a85c-4bd8-a1c8-807e4f1356bf tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18" status: 404 len: 111 microversion: 2.1 time: 0.030394 May 13 17:43:58.849797 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 741/1502] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:43:58 2022] GET /compute/v2.1/servers/9dd7a84a-b05b-4644-83ab-ab19772c2d18 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:44:02.158455 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-aa5c5d7b-c72a-4c9d-bc9f-b0881fa80218 req-c6f89930-e247-4504-acd8-a1bf1c3f2411 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89b80358-f455-40eb-9c58-8246a0f5e874", "tag": "145b3c79-f4a4-4cce-a4f7-e4034da0c4e2"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:44:02.162031 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-a72fb39f-2fca-4fd9-84a2-956c9db85534 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:44:02.162527 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a72fb39f-2fca-4fd9-84a2-956c9db85534 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:44:02.166913 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-aa5c5d7b-c72a-4c9d-bc9f-b0881fa80218 req-c6f89930-e247-4504-acd8-a1bf1c3f2411 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:44:02.167581 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-aa5c5d7b-c72a-4c9d-bc9f-b0881fa80218 req-c6f89930-e247-4504-acd8-a1bf1c3f2411 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:44:02.168932 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a72fb39f-2fca-4fd9-84a2-956c9db85534 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:44:02.173909 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a72fb39f-2fca-4fd9-84a2-956c9db85534 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:44:02.174730 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a72fb39f-2fca-4fd9-84a2-956c9db85534 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:44:02.175211 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-a72fb39f-2fca-4fd9-84a2-956c9db85534 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:44:02.183432 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-aa5c5d7b-c72a-4c9d-bc9f-b0881fa80218 req-c6f89930-e247-4504-acd8-a1bf1c3f2411 service nova] Creating event network-changed:145b3c79-f4a4-4cce-a4f7-e4034da0c4e2 for instance 89b80358-f455-40eb-9c58-8246a0f5e874 on hv-cinder-84178 May 13 17:44:02.190027 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-aa5c5d7b-c72a-4c9d-bc9f-b0881fa80218 req-c6f89930-e247-4504-acd8-a1bf1c3f2411 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033950 May 13 17:44:02.190027 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 742/1503] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:44:02.201169 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-a72fb39f-2fca-4fd9-84a2-956c9db85534 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Going to try to terminate instance {{(pid=117493) delete /opt/stack/nova/nova/compute/api.py:2664}} May 13 17:44:02.462083 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-a72fb39f-2fca-4fd9-84a2-956c9db85534 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "DELETE /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 204 len: 0 microversion: 2.1 time: 0.310004 May 13 17:44:02.463191 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 762/1504] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:44:02 2022] DELETE /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 13 17:44:02.472538 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-39274a0d-3d3e-42b7-8e64-91d09bf03539 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:44:02.473279 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-39274a0d-3d3e-42b7-8e64-91d09bf03539 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:44:02.479751 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-39274a0d-3d3e-42b7-8e64-91d09bf03539 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:44:02.480201 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-39274a0d-3d3e-42b7-8e64-91d09bf03539 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:44:02.481048 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-39274a0d-3d3e-42b7-8e64-91d09bf03539 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:44:02.481479 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-39274a0d-3d3e-42b7-8e64-91d09bf03539 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:44:02.612705 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.policy [None req-39274a0d-3d3e-42b7-8e64-91d09bf03539 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117492) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:44:02.620318 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-39274a0d-3d3e-42b7-8e64-91d09bf03539 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1578 microversion: 2.1 time: 0.152085 May 13 17:44:02.620895 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 743/1505] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:44:02 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1578 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:44:03.638319 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-84dd88e3-5573-416b-8026-1774fdd4da02 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:44:03.639659 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-84dd88e3-5573-416b-8026-1774fdd4da02 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:44:03.646032 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-84dd88e3-5573-416b-8026-1774fdd4da02 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:44:03.646486 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-84dd88e3-5573-416b-8026-1774fdd4da02 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:44:03.647290 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-84dd88e3-5573-416b-8026-1774fdd4da02 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:44:03.647734 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-84dd88e3-5573-416b-8026-1774fdd4da02 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:44:03.814237 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-84dd88e3-5573-416b-8026-1774fdd4da02 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:44:03.821933 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-84dd88e3-5573-416b-8026-1774fdd4da02 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1459 microversion: 2.1 time: 0.187839 May 13 17:44:03.822500 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 763/1506] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:44:03 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1459 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:44:04.338796 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [req-e3e95156-2b1b-4c03-acf2-6fb8bc18ecb2 req-284fcead-3e53-45c0-b0fb-45ef7f1eb0a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89b80358-f455-40eb-9c58-8246a0f5e874", "name": "network-vif-deleted", "tag": "145b3c79-f4a4-4cce-a4f7-e4034da0c4e2"}]} {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 13 17:44:04.347456 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-e3e95156-2b1b-4c03-acf2-6fb8bc18ecb2 req-284fcead-3e53-45c0-b0fb-45ef7f1eb0a4 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:44:04.347901 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [req-e3e95156-2b1b-4c03-acf2-6fb8bc18ecb2 req-284fcead-3e53-45c0-b0fb-45ef7f1eb0a4 service nova] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:44:04.363085 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.compute.server_external_events [req-e3e95156-2b1b-4c03-acf2-6fb8bc18ecb2 req-284fcead-3e53-45c0-b0fb-45ef7f1eb0a4 service nova] Creating event network-vif-deleted:145b3c79-f4a4-4cce-a4f7-e4034da0c4e2 for instance 89b80358-f455-40eb-9c58-8246a0f5e874 on hv-cinder-84178 May 13 17:44:04.368361 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [req-e3e95156-2b1b-4c03-acf2-6fb8bc18ecb2 req-284fcead-3e53-45c0-b0fb-45ef7f1eb0a4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033245 May 13 17:44:04.369669 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 744/1507] 10.222.0.64 () {64 vars in 1317 bytes} [Fri May 13 17:44:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 13 17:44:04.839519 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-2a304a61-518e-436a-81ce-80bf396632be tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:44:04.840144 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-2a304a61-518e-436a-81ce-80bf396632be tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:44:04.846551 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2a304a61-518e-436a-81ce-80bf396632be tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:44:04.847009 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2a304a61-518e-436a-81ce-80bf396632be tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:44:04.847815 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2a304a61-518e-436a-81ce-80bf396632be tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:44:04.848258 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-2a304a61-518e-436a-81ce-80bf396632be tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:44:04.908563 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.policy [None req-2a304a61-518e-436a-81ce-80bf396632be tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45482c562be6438ebd456ee9512ef3e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60fd06693c624da5aa61222dfbde5b25', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117493) authorize /opt/stack/nova/nova/policy.py:199}} May 13 17:44:04.916098 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-2a304a61-518e-436a-81ce-80bf396632be tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 200 len: 1226 microversion: 2.1 time: 0.080363 May 13 17:44:04.916661 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 764/1508] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:44:04 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 1226 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 13 17:44:05.934019 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-bb363d5b-354d-48bf-ba6c-44289d627f87 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:44:05.934720 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-bb363d5b-354d-48bf-ba6c-44289d627f87 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 89b80358-f455-40eb-9c58-8246a0f5e874] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:44:05.941810 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bb363d5b-354d-48bf-ba6c-44289d627f87 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:44:05.942262 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bb363d5b-354d-48bf-ba6c-44289d627f87 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:44:05.943039 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bb363d5b-354d-48bf-ba6c-44289d627f87 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:44:05.943509 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-bb363d5b-354d-48bf-ba6c-44289d627f87 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:44:05.957358 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-bb363d5b-354d-48bf-ba6c-44289d627f87 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] HTTP exception thrown: Instance 89b80358-f455-40eb-9c58-8246a0f5e874 could not be found. May 13 17:44:05.959011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-bb363d5b-354d-48bf-ba6c-44289d627f87 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Request method failure captured: May 13 17:44:05.959011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 HTTP/1.1 May 13 17:44:05.959011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:44:05.959011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:44:05.959011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:44:05.959011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 0 May 13 17:44:05.959011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:44:05.959011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:44:05.959011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:44:05.959011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:44:05.959011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpbIJS0Ge9t1DxCI2iC1Lb6YBjFX9xSuD6l_gEFNAJlxamiQplE07vcLq53y1WIzjIUkO30iIjWLvqh3-lAsVBmwcU_8Ys3w3tLJFKjdxPYj2yKw6_3vD25IxrS2Eid4K6B4Hf0C7Sp2TkdCIY6HRBNcQwG8NDBsE4sNW4AHLY2xLGw May 13 17:44:05.959011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:44:05.959011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:44:05.959011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:44:05.959011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:44:05.959011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:44:05.959011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:44:05.959011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: 60fd06693c624da5aa61222dfbde5b25 May 13 17:44:05.959011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-TestVolumeBootPattern-381584425 May 13 17:44:05.959011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:44:05.959011 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:44:05.960844 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/60fd06693c624da5aa61222dfbde5b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60fd06693c624da5aa61222dfbde5b25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_60fd06693c624da5aa61222dfbde5b25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60fd06693c624da5aa61222dfbde5b25"}]}] May 13 17:44:05.960844 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-TestVolumeBootPattern-381584425 May 13 17:44:05.960844 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: 60fd06693c624da5aa61222dfbde5b25 May 13 17:44:05.960844 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-TestVolumeBootPattern-381584425 May 13 17:44:05.960844 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-TestVolumeBootPattern-381584425-project May 13 17:44:05.960844 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:44:05.960844 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:44:05.960844 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: 45482c562be6438ebd456ee9512ef3e8 May 13 17:44:05.960844 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-TestVolumeBootPattern-381584425-project May 13 17:44:05.960844 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: > May 13 17:44:05.960844 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Instance 89b80358-f455-40eb-9c58-8246a0f5e874 could not be found. May 13 17:44:05.960844 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'id': '89b80358-f455-40eb-9c58-8246a0f5e874'} May 13 17:44:05.962012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:44:05.962012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:44:05.962012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:44:05.962012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:44:05.962012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:44:05.962012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:44:05.962012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:44:05.962012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:44:05.962012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:44:05.962012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:44:05.962012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89b80358-f455-40eb-9c58-8246a0f5e874 could not be found. May 13 17:44:05.962012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:44:05.962012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:44:05.962012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:44:05.962012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:44:05.962012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:44:05.962012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:44:05.962012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:44:05.962012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:44:05.962012 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:44:05.963911 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:44:05.963911 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:44:05.963911 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:44:05.963911 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:44:05.963911 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:44:05.963911 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:44:05.963911 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:44:05.963911 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89b80358-f455-40eb-9c58-8246a0f5e874 could not be found. May 13 17:44:05.963911 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:44:05.963911 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:44:05.963911 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:44:05.963911 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:44:05.963911 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:44:05.963911 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:44:05.963911 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:44:05.963911 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:44:05.963911 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89b80358-f455-40eb-9c58-8246a0f5e874 could not be found. May 13 17:44:05.963911 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:44:05.965509 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-bb363d5b-354d-48bf-ba6c-44289d627f87 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Returning 404 to user: Instance 89b80358-f455-40eb-9c58-8246a0f5e874 could not be found. {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:44:05.965509 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-bb363d5b-354d-48bf-ba6c-44289d627f87 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874" status: 404 len: 111 microversion: 2.1 time: 0.030687 May 13 17:44:05.965509 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 745/1509] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:44:05 2022] GET /compute/v2.1/servers/89b80358-f455-40eb-9c58-8246a0f5e874 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:44:06.480357 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9d170786-9b43-4f6c-83ab-df93e555ab1a tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:44:06.480889 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.compute.api [None req-9d170786-9b43-4f6c-83ab-df93e555ab1a tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117493) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:44:06.487492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9d170786-9b43-4f6c-83ab-df93e555ab1a tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:44:06.487947 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9d170786-9b43-4f6c-83ab-df93e555ab1a tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:44:06.488718 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9d170786-9b43-4f6c-83ab-df93e555ab1a tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:44:06.489158 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG oslo_concurrency.lockutils [None req-9d170786-9b43-4f6c-83ab-df93e555ab1a tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117493) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:44:06.502500 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.wsgi [None req-9d170786-9b43-4f6c-83ab-df93e555ab1a tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] HTTP exception thrown: Instance 28943379-c589-47c4-939d-c9c2b0e67b7f could not be found. May 13 17:44:06.504243 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9d170786-9b43-4f6c-83ab-df93e555ab1a tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Request method failure captured: May 13 17:44:06.504243 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: request: DELETE /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f HTTP/1.1 May 13 17:44:06.504243 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept: application/json May 13 17:44:06.504243 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Accept-Encoding: identity May 13 17:44:06.504243 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Connection: close May 13 17:44:06.504243 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Length: 0 May 13 17:44:06.504243 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Content-Type: application/json May 13 17:44:06.504243 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Host: 10.222.0.64 May 13 17:44:06.504243 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Openstack-System-Scope: None May 13 17:44:06.504243 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: User-Agent: python-urllib3/1.26.9 May 13 17:44:06.504243 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Auth-Token: gAAAAABifpbIJS0Ge9t1DxCI2iC1Lb6YBjFX9xSuD6l_gEFNAJlxamiQplE07vcLq53y1WIzjIUkO30iIjWLvqh3-lAsVBmwcU_8Ys3w3tLJFKjdxPYj2yKw6_3vD25IxrS2Eid4K6B4Hf0C7Sp2TkdCIY6HRBNcQwG8NDBsE4sNW4AHLY2xLGw May 13 17:44:06.504243 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Id: None May 13 17:44:06.504243 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Domain-Name: None May 13 17:44:06.504243 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Identity-Status: Confirmed May 13 17:44:06.504243 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Is-Admin-Project: True May 13 17:44:06.504243 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Id: default May 13 17:44:06.504243 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Domain-Name: Default May 13 17:44:06.504243 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Id: 60fd06693c624da5aa61222dfbde5b25 May 13 17:44:06.504243 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Project-Name: tempest-TestVolumeBootPattern-381584425 May 13 17:44:06.504243 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Role: reader,member May 13 17:44:06.504243 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Roles: reader,member May 13 17:44:06.505863 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/60fd06693c624da5aa61222dfbde5b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60fd06693c624da5aa61222dfbde5b25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_60fd06693c624da5aa61222dfbde5b25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60fd06693c624da5aa61222dfbde5b25"}]}] May 13 17:44:06.505863 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant: tempest-TestVolumeBootPattern-381584425 May 13 17:44:06.505863 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Id: 60fd06693c624da5aa61222dfbde5b25 May 13 17:44:06.505863 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-Tenant-Name: tempest-TestVolumeBootPattern-381584425 May 13 17:44:06.505863 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User: tempest-TestVolumeBootPattern-381584425-project May 13 17:44:06.505863 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Id: default May 13 17:44:06.505863 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Domain-Name: Default May 13 17:44:06.505863 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Id: 45482c562be6438ebd456ee9512ef3e8 May 13 17:44:06.505863 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: X-User-Name: tempest-TestVolumeBootPattern-381584425-project May 13 17:44:06.505863 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: method: > May 13 17:44:06.505863 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: exception: Instance 28943379-c589-47c4-939d-c9c2b0e67b7f could not be found. May 13 17:44:06.505863 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: action_args: {'id': '28943379-c589-47c4-939d-c9c2b0e67b7f'} May 13 17:44:06.506702 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:44:06.506702 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:44:06.506702 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:44:06.506702 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:44:06.506702 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:44:06.506702 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:44:06.506702 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:44:06.506702 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:44:06.506702 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:44:06.506702 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:44:06.506702 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28943379-c589-47c4-939d-c9c2b0e67b7f could not be found. May 13 17:44:06.506702 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:44:06.506702 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:44:06.506702 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:44:06.506702 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:44:06.506702 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:44:06.506702 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:44:06.506702 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:44:06.506702 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:44:06.506702 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:44:06.508492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:44:06.508492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 13 17:44:06.508492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 13 17:44:06.508492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 13 17:44:06.508492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 13 17:44:06.508492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:44:06.508492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:44:06.508492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:44:06.508492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:44:06.508492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28943379-c589-47c4-939d-c9c2b0e67b7f could not be found. May 13 17:44:06.508492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:44:06.508492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:44:06.508492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:44:06.508492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:44:06.508492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:44:06.508492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:44:06.508492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:44:06.508492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:44:06.508492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28943379-c589-47c4-939d-c9c2b0e67b7f could not be found. May 13 17:44:06.508492 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: ERROR nova.api.openstack.wsgi May 13 17:44:06.510235 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-9d170786-9b43-4f6c-83ab-df93e555ab1a tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Returning 404 to user: Instance 28943379-c589-47c4-939d-c9c2b0e67b7f could not be found. {{(pid=117493) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:44:06.510235 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-9d170786-9b43-4f6c-83ab-df93e555ab1a tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "DELETE /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 404 len: 111 microversion: 2.1 time: 0.029149 May 13 17:44:06.510235 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 765/1510] 10.222.0.64 () {58 vars in 1238 bytes} [Fri May 13 17:44:06 2022] DELETE /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:44:06.514646 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7c2f4479-62ef-4934-a8bb-5db50e825b7d tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '>' {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:44:06.515279 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.compute.api [None req-7c2f4479-62ef-4934-a8bb-5db50e825b7d tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] [instance: 28943379-c589-47c4-939d-c9c2b0e67b7f] Fetching instance by UUID {{(pid=117492) get /opt/stack/nova/nova/compute/api.py:2920}} May 13 17:44:06.521037 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7c2f4479-62ef-4934-a8bb-5db50e825b7d tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:44:06.521479 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7c2f4479-62ef-4934-a8bb-5db50e825b7d tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:44:06.522242 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7c2f4479-62ef-4934-a8bb-5db50e825b7d tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 13 17:44:06.522671 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG oslo_concurrency.lockutils [None req-7c2f4479-62ef-4934-a8bb-5db50e825b7d tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Lock "b14dab8a-67db-465f-b07a-be88db818145" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117492) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 13 17:44:06.535633 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.wsgi [None req-7c2f4479-62ef-4934-a8bb-5db50e825b7d tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] HTTP exception thrown: Instance 28943379-c589-47c4-939d-c9c2b0e67b7f could not be found. May 13 17:44:06.537103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7c2f4479-62ef-4934-a8bb-5db50e825b7d tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Request method failure captured: May 13 17:44:06.537103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: request: GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f HTTP/1.1 May 13 17:44:06.537103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept: application/json May 13 17:44:06.537103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Accept-Encoding: identity May 13 17:44:06.537103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Connection: close May 13 17:44:06.537103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Length: 0 May 13 17:44:06.537103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Content-Type: application/json May 13 17:44:06.537103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Host: 10.222.0.64 May 13 17:44:06.537103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Openstack-System-Scope: None May 13 17:44:06.537103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: User-Agent: python-urllib3/1.26.9 May 13 17:44:06.537103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Auth-Token: gAAAAABifpbIJS0Ge9t1DxCI2iC1Lb6YBjFX9xSuD6l_gEFNAJlxamiQplE07vcLq53y1WIzjIUkO30iIjWLvqh3-lAsVBmwcU_8Ys3w3tLJFKjdxPYj2yKw6_3vD25IxrS2Eid4K6B4Hf0C7Sp2TkdCIY6HRBNcQwG8NDBsE4sNW4AHLY2xLGw May 13 17:44:06.537103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Id: None May 13 17:44:06.537103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Domain-Name: None May 13 17:44:06.537103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Identity-Status: Confirmed May 13 17:44:06.537103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Is-Admin-Project: True May 13 17:44:06.537103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Id: default May 13 17:44:06.537103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Domain-Name: Default May 13 17:44:06.537103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Id: 60fd06693c624da5aa61222dfbde5b25 May 13 17:44:06.537103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Project-Name: tempest-TestVolumeBootPattern-381584425 May 13 17:44:06.537103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Role: reader,member May 13 17:44:06.537103 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Roles: reader,member May 13 17:44:06.538798 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/60fd06693c624da5aa61222dfbde5b25"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60fd06693c624da5aa61222dfbde5b25"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_60fd06693c624da5aa61222dfbde5b25"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/60fd06693c624da5aa61222dfbde5b25"}]}] May 13 17:44:06.538798 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant: tempest-TestVolumeBootPattern-381584425 May 13 17:44:06.538798 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Id: 60fd06693c624da5aa61222dfbde5b25 May 13 17:44:06.538798 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-Tenant-Name: tempest-TestVolumeBootPattern-381584425 May 13 17:44:06.538798 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User: tempest-TestVolumeBootPattern-381584425-project May 13 17:44:06.538798 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Id: default May 13 17:44:06.538798 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Domain-Name: Default May 13 17:44:06.538798 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Id: 45482c562be6438ebd456ee9512ef3e8 May 13 17:44:06.538798 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: X-User-Name: tempest-TestVolumeBootPattern-381584425-project May 13 17:44:06.538798 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: method: > May 13 17:44:06.538798 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: exception: Instance 28943379-c589-47c4-939d-c9c2b0e67b7f could not be found. May 13 17:44:06.538798 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: action_args: {'id': '28943379-c589-47c4-939d-c9c2b0e67b7f'} May 13 17:44:06.539869 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: {{(pid=117492) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 13 17:44:06.539869 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:44:06.539869 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 13 17:44:06.539869 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 13 17:44:06.539869 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 13 17:44:06.539869 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 13 17:44:06.539869 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 13 17:44:06.539869 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 13 17:44:06.539869 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 13 17:44:06.539869 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 13 17:44:06.539869 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 28943379-c589-47c4-939d-c9c2b0e67b7f could not be found. May 13 17:44:06.539869 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:44:06.539869 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:44:06.539869 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:44:06.539869 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:44:06.539869 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:44:06.539869 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:44:06.539869 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 13 17:44:06.539869 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 13 17:44:06.539869 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 13 17:44:06.541476 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 13 17:44:06.541476 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 13 17:44:06.541476 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 13 17:44:06.541476 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 13 17:44:06.541476 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 13 17:44:06.541476 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 13 17:44:06.541476 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 13 17:44:06.541476 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 28943379-c589-47c4-939d-c9c2b0e67b7f could not be found. May 13 17:44:06.541476 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:44:06.541476 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 13 17:44:06.541476 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:44:06.541476 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 13 17:44:06.541476 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 13 17:44:06.541476 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 13 17:44:06.541476 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 13 17:44:06.541476 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 13 17:44:06.541476 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 28943379-c589-47c4-939d-c9c2b0e67b7f could not be found. May 13 17:44:06.541476 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: ERROR nova.api.openstack.wsgi May 13 17:44:06.543277 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: DEBUG nova.api.openstack.wsgi [None req-7c2f4479-62ef-4934-a8bb-5db50e825b7d tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Returning 404 to user: Instance 28943379-c589-47c4-939d-c9c2b0e67b7f could not be found. {{(pid=117492) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 13 17:44:06.543277 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO nova.api.openstack.requestlog [None req-7c2f4479-62ef-4934-a8bb-5db50e825b7d tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f" status: 404 len: 111 microversion: 2.1 time: 0.028247 May 13 17:44:06.543277 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: [pid: 117492|app: 0|req: 746/1511] 10.222.0.64 () {58 vars in 1235 bytes} [Fri May 13 17:44:06 2022] GET /compute/v2.1/servers/28943379-c589-47c4-939d-c9c2b0e67b7f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 13 17:44:08.002770 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: DEBUG nova.api.openstack.wsgi [None req-e9f5bcf0-e6a8-469c-860e-5ba9cf4e9db8 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] Calling method '.version_select at 0x7fa0841b5430>' {{(pid=117493) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 13 17:44:08.074544 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO nova.api.openstack.requestlog [None req-e9f5bcf0-e6a8-469c-860e-5ba9cf4e9db8 tempest-TestVolumeBootPattern-381584425 tempest-TestVolumeBootPattern-381584425-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1402304854" status: 202 len: 0 microversion: 2.1 time: 0.075096 May 13 17:44:08.075639 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: [pid: 117493|app: 0|req: 766/1512] 10.222.0.64 () {58 vars in 1262 bytes} [Fri May 13 17:44:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1402304854 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 13 17:45:05.511597 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 17:45:05.512287 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Fri May 13 17:45:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 17:45:12.798443 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 17:45:12.799171 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Fri May 13 17:45:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 17:46:51.265649 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 17:46:51.266220 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Fri May 13 17:46:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 17:47:00.726041 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 17:47:00.726732 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Fri May 13 17:47:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 17:47:06.317645 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 17:47:06.318282 dv-cinder-841782-1-iscsi devstack@n-api.service[117493]: Fri May 13 17:47:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 17:47:23.091740 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 17:47:23.092253 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Fri May 13 17:47:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 17:48:25.519988 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 17:48:25.520750 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Fri May 13 17:48:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 13 17:48:32.807618 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 13 17:48:32.808400 dv-cinder-841782-1-iscsi devstack@n-api.service[117492]: Fri May 13 17:48:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!